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Abstract 


Air  Force  Office  of  Scientific  Research  support  of  a  Center  of  Excellence  at  Stanford 
University  has  provided  the  impetus  and  core  for  a  major  new  entity,  the  Center  for 
Automation  and  Manufacturing  Science  (CAMS).  The  new  center  draws  from  two  well- 
known  research  groups  at  Stanford:  the  Robotics  group  of  Stanford’s  Artificial  Intelligence 
Laboratory  and  the  Automatic  Control  Group  of  Stanford’s  Department  of  Aeronautics 
and  Astronautics.  Six  professors  and  some  35  graduate  students  are  participating  in  CAMS 
activities.  CAMS  in  turn  has  become  the  first  of  a  new  complex  of  four  centers  at  Stanford 
involved  in  the  manufacturing  enterprise:  the  Stanford  Institute  for  Manufacturing  and 
Automation  (SIMA).  Strong  industrial  interaction  is  a  primary  objective  of  SIMA. 

In  our  AFOSR  program  we  have  focused  on  robotic  aspects  of  automation.  Our  goal 
is  to  make  fundamental  contributions  to  the  underlying  set  of  technologies  that  will  enable 
the  next  generation  of  industrial  robots  to  be  far  more  capable  than  today’s  —  will  enable 
them  to  be  lightweight,  limber,  deft,  facile,  quick,  friendly,  low-powered,  seeing,  sensing, 
thinking  machines  that  can  reason  and  strategize  —  can  carry  out  tasks  assigned  at  a  high 
conceptual  level. 

Specifically,  our  research  focus  is  on  fast,  precise  control  of  lightweight  (flexible)  ma¬ 
nipulators,  on  sensing,  especially  optical  and  tactile  sensing,  on  intelligent  systems  for 
robot  task  management,  and  on  computer  vision  for  robot  management. 

In  the  context  of  a  gratifyingly  large  number  of  advances  we  have  been  able  to  make 
in  robotics  over  these  three  years,  some  major  research  results  achieved  under  this  contract 
include  the  following: 

Task  1:  Survey  of  Key  Problems  and  Technology  Transfer 

We  have  identified,  and  pursued  toward  solution  in  our  laboratories,  a  set  of  key 
technical  problems  whose  resolution  will  enable  major  advances  in  the  capability  of  au¬ 
tomation  using  robots.  These  key  problems  are  in  the  areas  of  intelligent  robotic  systems 
(including  task  management,  vision,  and  system  integration)  of  fast,  precise  control  of 
very  lightweight,  flexible  robotic  manipulators,  and  of  advanced  tactile  sensing;  and  our 
contributions  to  their  solution  are  enumerated  below. 

We  have  committed  our  resources  to  ongoing  technology  transfer  through  vigorous 
interaction  with  a  set  of  major  aerospace  manufacturing  companies  including  the  13  sponsor 
companies  of  our  formal  structure,  SIMA. 

Task  2:  Intelligent  Systems  in  Manufacturing,  Inspection  and  Vision 

a.  A  system  of  real-time  collision  avoidance  was  implemented.  The  system  is  based  on  the 
use  of  potential  functions  around  obstacles.  Obstacles  are  described  by  composition 
of  primitives  which  are  approximately  cylinders  and  blocks.  The  method  requires  a 
small  amount  of  calculation;  it  allows  obstacle  avoidance  to  occur  in  real  time  as  an 
integral  part  of  the  servo-control.  An  experimental  manipulator  programming  system 
"COSMOS*  using  the  method  has  been  designed  for  the  PUMA  and  demonstrated 


with  obstacles  (including  mobile  obstacles)  detected  by  an  MIC  vision  module. 

b.  A  dynamic  simulator  was  implemented  as  a  software  equivalent  of  a  robot  arm.  So  far, 
the  simulator  has  been  used  to  test  three  adaptive  control  schemes,  several  dynamic 
control  schemes,  and  two  parameter  estimation  schemes. 

c.  A  new,  nonlinear,  and  generalisable  technique  has  been  developed  that  will  continually 
monitor  the  parameters  of  a  robot  arm  to  estimate  continuously  the  inertial  forces  and 
the  friction  in  robot  joints.  This  system  has  also  been  simulated  for  a  three-link  robot, 
and  has  been  successfully  applied  to  a  physical  single  link  robot  as  well. 

d.  We  have  completed  joint  force  sensing  for  one  joint  of  the  PUMA,  and  have  designed 
a  touch  sensing  finger  which  senses  three  components  of  force. 

e.  Contributions  have  been  made  toward  a  successor  for  ACRONYM,  an  intelligent  sys¬ 
tem  developed  at  Stanford  and  adopted  by  about  a  dosen  laboratories  and  companies. 
The  modeling  system  of  SUCCESSOR  is  greatly  generalised  to  include  multiple  nam¬ 
ing,  holes  and  set  operations  on  volumes  (union,  intersection,  difference).  Work  in 
other  areas  of  computer  vision  includes  architecture  of  VLSI  vision  processors,  seg¬ 
mentation  with  edge  operators,  graphics  support,  and  hardware  support. 

f.  The  Automatic  Task  Level  Assembly  Synthesiser  (ATLAS)  was  advanced  significantly 
in  power  and  usability.  A  high  level  task  specification  model  was  developed  and 
demonstrated;  advances  were  made  in  fine  motion  synthesis  and  constraint  integration. 

g.  Several  portable  versions  of  LISP  have  been  developed  and  both  utilised  at  Stanford 
and,  indeed,  transported.  These  include  subset  SLISP  for  VAX  systems  and  TAIL  for 
SUN  work  stations. 

h.  Both  software  and  hardware  support  for  vision  systems  include:  software  for  interfac¬ 
ing  the  Grinnell  display;  LISP  graphics;  interface  for  an  expensive  TV  input  system; 
convolution  software;  TV  time  base  corrector;  an  interface  for  an  Optronics  drum 
scanner;  work  on  software  for  a  GTCO  digitising  tablet;  and  an  interface  for  an  image 
hard  copy  output  device. 

i.  Implementation  of  a  new  edge  operator,  tests  of  shape  from  a  shading  algorithm,  and 
experimentation  toward  building  an  active  ranging  device  are  underway. 

Task  3:  Rapid,  Precise  Control  of  Nonrigid  Manipulators 

The  goal  is  to  provide  manipulator  control  so  good  that  a  whole  new  generation 
of  manipulators  can  be  developed  —  manipulators  that  are  much  lighter  and  far  more 
facile  than  anything  today’s  control  systems  could  stably  manage.  To  do  this  we  are 
developing  a  sequential  family  of  new  manipulators  that  are  extremely  light  and  flexible, 
deliberately  exaggerating  the  control  problem  so  that  it  will  have  to  be  solved  in  much 
more  fundamental  ways  than  it  ever  has  before. 

The  central  control  problem  for  each  of  these  manipulator  systems  is  the  problem  of 
controlling  the  end-point  (fingertips)  of  a  manipulator  by  measuring  position  or  force  at 
that  point  and  using  that  measurement  to  control  torque  at  an  actuator  at  the  other  end 
(elbow  or  shoulder)  of  the  flexible  manipulator.  This  turns  out  to  be,  for  fundamental 
stability  reasons,  very  hard  to  do. 


a.  For  very  flexible  manipulator  arms  (two-second  vibration  period),  we  have  succeeded 
in  achieving  control  that  is  not  only  stable  but  highly  robust,  and  at  a  speed  limited 
basically  by  wave  propagation  times  in  the  manipulators  themselves. 

b.  A  new  technology,  the  “quick  wrist*  was  developed  for  enhancing  (by  a  factor  of  10) 
the  within-work-station  task  speed  of  a  long,  very  flexible  robotic  manipulator.  Again, 
high-bandwidth  end-point  feedback  control  was  accomplished  for  the  first  time,  and 
rapid  pick-and  place  and  slew-and  snatch  maneuvers  have  been  demonstrated. 

c.  A  light-weight  experimental  two-link  arm  was  designed  and  built  with  very  flexible 
tendons  (representing  drive-train  flexibility).  High-bandwidth  control  using  end-point 
feedback  has  now  been  accomplished  for  the  first  time  and  shown  to  be  more  precise 
and  ten  times  faster  than  conventional  joint  control.  A  whole  sequence  of  key  basic 
developments  and  experiments  are  made  possible  by  this  equipment,  and  are  now 
underway. 

d.  Two  sets  of  fundamental  contributions  were  made  to  strategy  for  minimum-time  con¬ 
trol  of  generic  pick-and- place  robot  maneuvers,  and  for  chasing  and  capturing  a  mov¬ 
ing,  swinging  part. 

e.  Three  new  adaptive  control  schemes  have  been  developed,  and  two  of  them  demon¬ 
strated  experimentally  at  this  writing.  More  importantly,  new  discoveries  have  been 
made  about  the  dominance  of  noise  in  real-time  dynamic  identification,  and  new  means 
developed  and  demonstrated  for  dealing  with  it. 

Task  4:  Ultraminiature  Tactile  Pressure  Sensor  Arrays 

a.  A  millimeter-sized  silicon  pressure  transducer  (CPT)  prototype  for  a  tactile  array 
element  that  is  integrated  with  a  silicon  integrated  circuit  system  has  been  designed, 
and  the  new  micromachining  techniques  required  for  its  fabrication  have  been  invented 
and  demonstrated. 

b.  A  custom  integrated  circuit  for  (and  to  be  integrated  with)  the  silicon  capacitive 
pressure  sensor  has  been  built  and  tested.  The  accuracy  is  ±  0.7  mm  Hg  over  a  range 
of  300  mm  Hg. 

c.  An  integrated  circuit  for  Tactile  Array  Interpretation  has  been  designed  and  its  circuit 
blocks  simulated  successfully.  An  Asynchronous  Digital  Multiplexer  (ADM)  imple¬ 
ments  a  novel  system  architecture. 

Even  more  important  than  the  specific  research  accomplishments  listed  above  is  the 
the  achievement  of  the  Ph.D.  degree  by  10  of  our  CAMS  students  (5  with  AFOSR  support), 
who  now  have  deep  experience  and  interest  in  aerospace  and  manufacturing  automation. 
So  far,  8  of  the  graduates  from  CAMS  have  joined  7  major  aerospace  companies.  In 
the  “pipeline”  are  currently  additional  students  engaged  in  Ph.D.  research  in  our  CAMS 
laboratories;  and  we  expect  most  of  them  to  follow  the  initial  ten  into . 
community. 


» 


Table  of  Contents 


Abstract . i 

Table  of  Contents . iv 

^  Introduction . v 

Technical  Report . 1 

Task  1.  Survey  of  Key  Problems  and  Technology  Transfer . 1 

Task  2.  Intelligent  Systems  for  Manufacturing;  Inspection  and  Vision  ....  6 

*  Overview  . 6 

Planning . 7 

Inspection  and  Vision . 11 

Prediction . 12 

References  and  Publications . 16 

Task  3.  Rapid,  Precise  End-Point  Control  of  Nonrigid  Manipulators  ....  17 

a.  Two-Link  Manipulator  with  Flexible  Tendons . 23 

b.  Very  Flexible  Manipulator  with  Fast  Wrist  . 55 

c.  Strategies  for  Task  Command  and  Control  of  Two-Link  Manipulators  .  97 

d.  Adaptive  Control . 99 

References  and  Publications . 132 

#  Tbsk  4.  Integrated  Tactile  Systems . 133 

Objective,  Design  Goals  and  Development  Plan . 133 

Integrated  Circuit  for  a  Capacitve  Pressure  Transducer . 134 

An  Integrated  Circuit  for  Tactile  Array  System  Management . 136 

^  Micromachining  . 146 

Related  Publications . 149 

Appendix  A  -  Personnel . 151 

Appendix  B  -  Statement  of  Work . 153 

®  Appendix  C  -  Predicting  Specular  Features . 155 

Appendix  D  -  On  the  Design  of  a  Geometric  Modeling  System . 165 

Appendix  E  -  Sensor  Modeling  for  Prediction  . 173 

Appendix  F  -  Summary  for  85 . 177 

~  Appendix  G  -  Minimum-Time  Control  of  a  Two- Link  Robot  Arm  . 187 


iv 


INTRODUCTION 


R 


3 

% 

(V 

1 


» 


* 


* 


g 


In  1982  we  were  privileged  to  be  invited  by  the  U.S.  Air  Force  Office  of  Scientific 
Research  to  propose  to  establish  at  Stanford  University,  with  major  AFOSR  funding,  a 
Center  of  Excellence  in  Manufacturing  and  Automation.  This  report  describes  the  devel¬ 
opment  of  our  Center,  the  Stanford  Center  for  Automation  and  Manufacturing  Science 
(CAMS),  and  the  accomplishments  that  the  AFOSR  funding  have  already  made  possible 
during  its  first  three  years. 

Most  notably,  the  vision  of  the  original  AFOSR  creators  has  been  more  than  fulfilled 
in  the  form  of  a  new  entity  —  the  Stanford  Institute  for  Manufacturing  and  Automation 
(SIMA)  —  whose  scope  goes  manifold  beyond  the  original  AFOSR  plan.  For,  as  hoped,  the 
AFOSR  funding,  complemented  by  a  major  grant  from  IBM  for  master's-level  training  in 
manufacturing  management,  has  stimulated  the  establishment  of  not  one,  but  four  centers 
in  manufacturing-related  high  technology,  the  four  being  affiliated  through  SIMA  which 
now  counts  13  corporations  among  its  sponsors. 

Thus,  while  the  purpose  of  the  present  report  is  to  summarize  the  first  three  yean  of 
AFOSR  sponsored  accomplishments  in  CAMS,  we  do  want  to  call  attention  first  to  the 
larger  scope  of  SIMA  which  the  AFOSR  sponsorship  has  helped  engender,  and  which  was 
equally  part  of  the  AFOSR  vision.  The  structure  and  scope  of  SIMA  are  described  under 
Task  1,  along  with  a  list  of  its  13  corporate  memben,  and  the  quite  vigorous  interactions 
we  are  having  with  them. 

To  focus  now  on  CAMS,  per  se:  the  goals  of  this  center,  started  by  AFOSR,  are  to 
contribute  a  series  of  key  advances  to  the  technology  areas  that  will  be  central  to  the  next 
generation  of  intelligent  machines  and  robots  —  basic  advances  that  will  in  fact  be  enabling 
to  the  next  generation. 

The  new  Center  draws  from  two  internationally  known  research  groups  at  Stanford: 
the  Robotics  Group  of  Stanford's  Artificial  Intelligence  Laboratory,  and  the  Automatic 
Control  Group  of  Stanford’s  Department  of  Aeronautics  and  Astronautics.  A  common 
objective  that  we  are  able  to  address  together,  with  this  major  Air  Force  support,  is  to  ad¬ 
vance  the  effectiveness  of  automation  in  manufacturing  by  mounting  research  concurrently 
—  and  synergistically  —  into  a  set  of  the  primary,  pacing  technologies  in  automation,  as 
we  outline  below. 

In  the  laboratories  of  CAMS,  some  35  graduate  students  carry  out  Ph.D.  level  research 
on  selected  projects  in  intelligent  machines  and  robotics,  working  with  6  professors  and  8 
professionals  and  technical  staff. 

In  our  Air  Force  program  we  have  decided  to  focus  on  robotic  aspects  of  automation. 
With  their  requirements  for  greater  flexibility  of  use  and  rapid  task  redirection,  the  robotic 
aspect  of  automated  manufacturing  will  draw  upon  more  of'the  new  technologies,  and  more 
deeply,  than  any  other  aspect. 

If  the  right  set  of  technologies  is  developed,  we  believe  the  next  generation  of  robots 
can  (by  comparison  with  today’s)  be  lightweight,  limber,  deft,  facile,  quick,  friendly,  low- 
powered,  seeing,  sensing,  thinking  machines.  Above  all,  they  will  be  capable  of  reasoning 
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and  strategizing  —  of  carrying  out  tasks  assigned  at  a  high  conceptual  level  by  "thinking 
through"  the  best  way  to  carry  out  any  given  task.  Robotic  devices  with  such  charac¬ 
teristics  and  capability  can  provide  the  flexible  automation  that  will  be  so  important  in 
achieving  higher  levels  of  productivity. 

What  are  the  underlying  technologies  that  will  be  needed  as  the  base  for  robots  with 
such  capabilities?  They  can  be  described  in  four  categories:  manipulator  control,  sensing, 
thinking,  vision.  Among  us,  in  our  Center,  we  are  working  to  make  useful  contributions 
in  all  four  technical  areas.  There  is,  of  course,  much  interaction  between,  and  synergism 
among  the  four  areas;  and  that  is  the  exciting  thing  about  the  level  of  effort  that  the 
AFOSR  program  makes  possible.  Specifically,  fast,  precise  manipulator  control  is  the 
primary  focus  of  Task  3  of  the  program,  tactile  sensing  of  Task  4,  and  computer-based 
thinking  and  vision  of  Task  2.  But  these  depend  upon  each  other  altogether  as  diagramed  in 
Fig.  1,  and  draw  upon  one  another  in  many  ways.  We  feed  back  signals  from  many  sensors 
—  optical  and  eventually  perhaps  acoustic,  as  well  as  tactile  and  force  —  to  effect  good 
end-point  control  of  manipulators.  New,  more  competent  manipulators,  with  their  multiple 
sensors,  will  be  utilized  avidly  by  task- management  systems  to  produce  new  assembly 
sequences  that  are  quicker,  more  precise,  and  more  efficient. 

More  acute  robot  vision,  together  with  more  rapid  visual  perception  (scene  analysis) 
are  very  important  basics  for  more  effective  task  planning,  and  may  even  someday  be  used 
in  real  time  by  the  fast  manipulator  controllers  themselves. 

And  of  course  in  an  ubiquitous  way,  our  overview  task,  Task  1,  of  the  program  has 
drawn  totally  upon  —  and  stimulated  —  all  of  the  other  tasks.  For  Task  1  is  to  work 
with  the  industrial  automation  community  to  survey  in  a  continuing  way  the  problems  of 
automation,  and  to  effect  technology  transfer  to  designers  of  new  automation  systems  as 
each  advance  becomes  demonstrable  in  our  laboratories.  Thus  while,  for  convenience,  we 
discuss  the  four  research  Ihsk  areas  separately  in  the  following  paragraphs,  and  as  separate 
sections  of  this  report,  they  are  in  fact  highly  interrelated  in  our  Center. 

Under  direct  AFOSR  support,  there  has  taken  place  in  the  Stanford  Artificial  Intel¬ 
ligence  Laboratory  (SAIL)  basic  development  of  more  effective  languages  for  managing 
robot  tasks  now  culminating  in  the  SUCCESSOR  system  and  including  new  work  in  ex¬ 
tending  prediction  to  a  variety  of  sensors  and  multisensor  tasks,  and  work  on  vision  that 
now  provides  a  firm  basis  for  prediction  and  interpretation  of  image  data. 

In  the  Aerospace  Robotics  Laboratory  (ARL),  we  have  constructed  a  new  facility 
for  developing  lightweight,  very  flexible,  multiple-link  manipulators;  and  we  have  demon¬ 
strated  experimentally  (for  the  first  time)  solution  to  the  very  difficult  problem  of  control¬ 
ling  the  motions  of  such  manipulators  quickly  and  precisely  using  end-point  feedback.  We 
have  also  demonstrated  a  new  concept,  the  end-point-controlled  quick  wrist,  which  has 
dramatic  potential  for  a  new  level  of  performance  by  future  robots.  Also,  we  have  been 
making  important  advances  in  adaptive  control,  .achieving  (for  the  first  time)  experimental 
real-time  high-bandwidth  adaptive  control  of  dynamic  systems  having  lightly-damped  vi¬ 
brating  natural  modes.  We  hope  to  make  major  new  strides  of  a  fundamental  kind  in  this 
area  using  the  experimental  systems  our  Air  Force  funding  has  allowed  us  to  develop.  We 
have  also  made  a  good  start  on  trajectory  management  strategies  which  will  be  important 
as  we  apply  our  control  capability  to  multiple-link  and  cooperating  robot  tasks  requiring 
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high  speed  and  precision. 


Rapid  Precise  Control  of  Nonrigid  Manipulators 

Manipulators  —  arms  and  hands  with  their  actuators,  and  the  increasingly  sophisti¬ 
cated  feedback  systems  that  control  their  movements  —  are  the  “business  end”  of  a  robot, 
where  parts  are  mechanically  moved,  formed,  placed,  fitted  together  (or  dismantled),  and 
inspected.  In  our  Controls  Group  we  are  addressing  the  question  of  how  to  provide  ma¬ 
nipulator  control  so  good  that  a  whole  new  generation  of  manipulators  can  be  developed 
—  manipulators  that  are  much  lighter  and  far  more  facile  than  anything  today’s  control 
systems  could  stably  manage: 

To  do  this  we  have  begun  to  develop  a  sequential  family  of  new  manipulators  that 
are  extremely  light  and  flexible,  deliberately  exaggerating  the  control  problem  so  that  it 
will  have  to  be  solved  in  much  more  fundamental  ways  than  it  ever  has  before.  Some 
members  of  our  family  of  manipulators  are  shown  in  Fig.  2.  The  family  will  also  extend  in 
many  ways  not  shown  —  to  three  dimensional  action,  and  to  mobile-mounted  very  flexible 
manipulator  systems,  for  example. 

The  central  control  problem  for  each  of  these  manipulator  systems  —  and  the  problem 
we  have  been  the  first  to  solve  —  is  the  problem  of  controlling  the  end-point  (fingertips) 
of  a  manipulator  by  measuring  position  force  at  that  point  and  using  that  measurement  to 
control  torque  at  an  actuator  at  the  other  end  (elbow  or  shoulder)  of  the  flexible  manipu¬ 
lator.  This  turns  out  to  be,  for  fundamental  stability  reasons,  very  hard  to  do.  Every  time 
someone  has  tried  it  (this  non- colocated  control)  in  commercial  robots,  the  robot  system 
has  gone  unstable. 

Using  advanced  control  methods  developed  in  our  laboratory  we  have  already  suc¬ 
ceeded  in  achieving,  for  the  first  four  configurations  of  Fig.  2,  control  that  is  not  only 
stable  but  highly  robust,  and  at  a  speed  limited  basically  by  wave  propagation  times  in 
the  manipulators  themselves.  (The  achievement  for  the  system  in  Fig.  2a  was  by  Eric 
Schmitz,  for  Fig.  2b  by  James  Maples,  and  for  Fig.  2c  Scott  Tilley  under  other  funding.) 

By  proceeding  step-wise  with  the  sequence  of  basic  manipulator  control  problems 
indicated  in  Fig.  2,  we  expect  to  provide  the  fundamental  new  technology  for  controlling 
a  new  generation  of  lightweight  flexible  robots. 

In  the  first  year  of  this  contract  we  developed  two  important  new  experimental  sys¬ 
tems:  the  two-link  arm  with  flexible  tendons  and  the  very  flexible  arm  with  quick  wrist. 
In  the  second  year  we  achieved  remarkable  performance  with  the  latter,  and  succeeded  in 
our  first  successful  closed-loop  control  of  the  former.  We  also  developed  two  preliminary 
control  strategies  for  achieving  the  full  potential  of  the  two-link  arm.  In  this  final  year  we 
have  brought  the  two-link  arm  close  to  the  very  fast,  precise,  end-point  control  of  which  we 
know  it  to  be  capable:  with  end-point  control  we  have  already  achieved  stable  response  to 
position  commands  that  is  10  times  as  fast  as  is  possible  with  conventional  joint-angle  con¬ 
trol.  These  research  directions  continue:  to  move  into  3-D,  we  have  added  a  vertical-axis 
control  with  gripper  to  the  two-link  arm  (visible  in  Fig.  4)  with  which  we  will  carry  out  a 
series  of  carefully  designed  pick- and- place  and  moving-target-capture  tasks.  We  will  also 
pursue  extending  the  valuable  quick-wrist  capability  to  two  dimensions,  both  as  indicated 


(a)  Very  Flexible  Oaa>Liaik  Manipulator 
(Rapid  pick  and  place.) 

(b)  Very  Flexible  Manipulator  with  Force  Control 
(Slew  and  Touch  moving  target.) 


(e)  Flexible  Manipulator  with  Fact  Wrist 
(Precise  snatch  and  place.) 


(d)  Flexible  Manipulator  with  Fast  Wrist 
.(Slew  and  Precision  touch.) 


(e)  Two-Link  Ann  with  Elastic  Tendons 

(3D  pick  and  place;  slew  and  position  touch.) 


(f)  Cooperating  Two-Link  Arms 
(Long-part  handling.) 


(g)  Two-Link  Arm  with  Double  Wrist 
(Very  fast  precise  3D  tasks.) 

(h)  Two-Flexible-Link  Arm 


Fig.  3  Sequence  of  Expermentai  systems* 

(A  through  E  built  and  tested;  F  through  H  under  development) 


in  Fig.  2g,  and  also  for  the  very  flexible  arm  of  Fig.  2d.  (We  will  also  look  at  the  *R-0* 
alternative  configuration.) 

We  have  begun  detailed  design  for  a  new  apparatus,  Fig.  2h,  with  which  to  uncover 
and  solve  the  problems  of  controlling  multiple  very  flexible  arms.  In  these  first  fundamental 
studies  we  will  concentrate  on  the  flexibility  problem,  "deferring  gravity  by  supporting 
the  elbow  and  wrist  on  air  cushions.  (We  will  accommodate  gravity  subsequently,  as  we 
did  in  going  from  the  systems  of  Fig.  2a-d,  to  those  of  Fig.  2e-g.) 

A  primary  future  thrust  will  be  developing  adaptive  control  systems  for  our  physical 
robot  experimental  systems,  one  after  another,  beginning  with  Fig.  2d.  Adaptive  control 
has  received  much  lip  service  and  a  great  deal  of  theoretical  treatment  and  computer 
simulation.  But  its  use  in  controlling  actual  physical  systems  is  so  far  confined  to  very 
slow  chemical  plants:  applications  to  high  speed  systems,  especially  vibrating  ones,  are 
essentially  nonexistent.  There  are  good  reasons  why  successes  in  computer  simulation 
have  not  translated  to  any  real-world  success.  We  intend  to  make  progress  in  this  area 
that  is  so  important  to  fast  control  of  lightweight  robots.  We  have  developed  a  special 
experimental  four-disk  system  with  very  low  damping  f  <  .001  that  provides  a  most  severe 
test  for  any  adaptive  control  scheme  that  uses  end-point  feedback.  We  now  use  this  as  our 
first  testing  ground  before  proceeding  to  adaptive  control  of  the  various  manipulators  in 
Fig.  2.  During  the  current  year,  we  completed  the  testing  of  our  second  and  third  adaptive 
control  systems  on  the  vibrating-disk  apparatus;  and  we  are  now  applying  one  of  them  to 
the  very  flexible  manipulator. 

Fast  Wrist  on  a  Flexible  Arm 

The  advance  of  Fig.  2c,  development  of  a  small  quick- acting  wrist  mounted  on  a  very 
flexible  long  arm,  was  accomplished  by  Wen  Wie  Chiang  entirely  with  AFOSR  funding. 
This  new  system,  shown  in  Fig.  3,  has  several  generic  implications  for  future  robot  systems, 
which  can  be  inferred  from  the  experimental  performance  represented  in  Fig.  5. 

The  wrist,  a  short  link  17  cm.  long,  is  installed  at  the  tip  of  a  97  cm.  flexible  beam, 
Figs.  3  and  5a.  The  wrist  is  light  and  rigid  compared  with  the  flexible  beam,  and  is 
controlled  by  a  separate  DC  motor.  A  lamp  is  mounted  at  the  tip  of  the  wrist  to  indicate 
the  end-point  position  (where  various  end  effectors  are  to  be  mounted).  A  silicon  photo 
sensor  mounted  above  the  apparatus  senses  the  position  of  the  lamp,  and  this  tip  position 
is  the  primary  signal  for  controlling  tip  position. 

Figure  5b  is  a  time  sequence  of  the  system  moving  between  two  workstations.  Generi- 
cally,  when  a  robot  manipulator  is  used  either  in  a  fabrication  or  assembly  job,  the  area  of 
workstation  is  small  compared  with  the  reachable  region  of  the  manipulator,  a  region  that 
may  include  several  stations.  To  achieve  the  most  efficient  operation,  the  manipulator  has 
to  move  rapidly  from  station  to  station,  but  at  the  same  time  be  able  to  perform  tasks 
within  a  station  under  accurate,  very-high-bandwidth  control. 

A  rigid  and  heavy  manipulator  cannot  achieve  high  speed  and  bandwidth  with  a 
reasonable  amount  of  power  consumption.  A  lighter  large  manipulator  can  be  moved 
faster  when  its  flexibility  is  under  proper  control,  as  we  have  demonstrated  (Fig.  2a);  but 
the  maximum  bandwidth  of  the  dosed  loop  is  still  limited  by  its  flexibility,  i.e.,  within  the 
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Photograph  of  the  Stanford  Two-Link  Manipulator  with  Flexible 


immediate  vicinity  of  the  end  of  the  larger  manipulator. 

Figure  5  presents  an  experimental  demonstration  of  how  the  combination  works  to 
get  optimum  system  performance.  In  Fig.  5b,  the  long  flexible  arm  moves  the  wrist  from 
one  workstation  to  the  next.  In  Fig.  5c  and  d,  a  commanded  change  in  the  tip  position 
within  the  workstation  is  accomplished  by  the  fast  wrist  almost  instantaneously  (A,B),  and 
that  tip  position  is  held  rigidly  in  space  while  the  slower  flexible-arm  end  is  brought  into 
alignment  (C,D,E).  (It  is  striking  to  watch  the  tip  obey  commands  in  space  so  precisely, 
regardless  of  motion  of  its  supporting  links.) 


Two-Link  Strategy 

Under  funding  by  DARPA  we  have  developed  capability  for  force  control  of  flexible 
manipulators  (Fig.  2b  and  d)  using  end-point  feedback,  and  are  now  building  a  new  ex¬ 
perimental  system  with  which  we  plan  to  develop  the  control  technology  for  intimately 
cooperating  manipulators,  Fig.  2f.  With  funding  from  NASA  we  are  concentrating  on  mo¬ 
bile  robot  control.  While  our  focus  is  on  the  simulation  of  space  robots  (using  air  cushion 
vehicles),  the  implications  for  mobile  robots  in  a  manufacturing  environment  are  quite 
direct. 

It  may  be  helpful  to  have  a  clear  picture  of  how  our  AFOSR-funded  research  projects 
interact  with  other  projects  in  our  laboratory.  Such  an  overview  is  presented  in  Fig.  3-1. 

Intelligent  Systems  for  Robot  Management  and  Vision 

We  developed  a  new  version  of  AL,  a  programming  system  which  is  portable  among 
computers  and  between  robots,  and  which  demonstrates  capabilities  for  programming  man¬ 
ufacturing  systems  also.  Under  this  contract,  a  new  version  of  AL  was  brought  into  opera¬ 
tion  and  implemented  major  parts  of  the  AL  user  interface,  a  syntactic  editor  and  symbolic 
debugger.  The  new  version  included  the  following  features:  (1)  graphics  for  forces  and  dy¬ 
namics,  new  syntax  to  allow  AL  programs  to  make  use  of  recently  added  abilities  in  the 
arm  servo  code,  especially  incremental  motions,  individual  joint  motions,  and  joint  sensing; 
(2)  reading  force  vectors  from  the  force  wrist  in  arbitrary  coordinate  systems;  (3)  a  variety 
of  new  motion  clauses  to  specify  desired  configurations  such  as  straight-line  (Cartesian) 
motions;  and  (4)  a  SAY  statement  to  access  the  speech  synthesiser  from  AL  programs. 
Subsequently,  under  other  support,  AL  and  COSMOS  systems  have  become  well  developed 
and  advanced. 

During  this  contract,  research  on  programming  systems  began  with  intermediate  level 
systems  for  programming  robots,  i.e.,  the  AL  system  and  the  COSMOS  system  for  force 
control  and  collision  avoidance. 

In  the  second  year,  the  effort  shifted  to  intelligent  systems  for  planning  robot  actions 
and  for  planning  inspection  and  vision  tasks.  These  systems  with  geometric  models  and 
geometric  reasoning  have  a  contribution  for  general  manufacturing,  beyond  those  tasks  we 
investigate  here. 

The  ATLAS  system  was  begun  to  investigate  general  methods  for  planning  robot 


actions.  The  effort  now  focuses  on  synthesis  of  sensor-controlled  fine  motion.  It  is  planned 
to  couple  ATLAS  with  Cosmos  or  AL,  putting  out  fine  motion  commands  for  force  control. 

An  intelligent  system  for  planning  vision,  SUCCESSOR,  incorporates  geometric  mod¬ 
els  and  reasoning  about  geometry.  Progress  has  been  made  toward  a  powerful  modeling 
system  with  generic  and  individual  models  made  of  generalised  primitives  linked  by  set 
operations;  a  very  general  intersection  program  is  being  developed.  A  system  for  building 
models  was  implemented. 

Prediction  mechanisms  for  making  use  of  expectations  about  images  and  measure¬ 
ments  have  been  developed.  Symbolic  graphics  provide  detailed  methods  for  individual 
objects  in  fixed  states.  A  sensor  modeling  system  is  bring  developed  for  sensory  integra¬ 
tion  and  multi-sensor  tasks.  A  study  of  specularity  has  led  to  methods  for  predictions  of 
specularities  and  for  use  of  specularities  to  estimate  surface  properties.  Theoretical  studies 
have  determined  a  generic  observability  model  and  a  family  of  quasi-invariant  observables 
for  prediction  and  recognition  of  metric  properties  of  objects. 

A  system  for  real-time  collision  avoidance  was  implemented  by  Khaiib.  The  system 
is  based  on  the  use  of  potential  functions  around  obstacles.  Obstacles  are  described  by 
composition  of  primitives  which  are  approximately  cylinders  and  blocks.  The  method 
requires  a  small  amount  of  calculation;  it  allows  obstacle  avoidance  to  occur  in  real  time 
as  an  integral  part  of  the  servo-control. 

Previous  research  in  obstacle  avoidance  has  focused  on  the  development  of  path  plan¬ 
ning  algorithms,  aimed  at  providing  a  tree  Cartesian  path  for  the  manipulator.  A  co¬ 
ordinate  transformer  generates  the  joint-space  path  for  the  servo-control  level.  The  high 
complexity  of  computation  in  such  approaches  leads  to  serious  problems  in  real  time  control 
of  a  manipulator  meant  to  act  in  a  complex  and  evolving  environment. 

We  have  developed  a  new  control  scheme  based  on  the  construction  of  a  dynamic  model 
of  a  manipulator  in  operational  space  (task-space)  rather  than  joint-space.  This  allows  a 
simple  force  transformation  to  replace  the  difficult  conversion  of  the  Cartesian  path  into 
joint  coordinates.  The  philosophy  of  this  approach  is  to  say  that  the  manipulator  moves 
in  a  field  of  forces.  The  position  to  be  reached  is  an  attractive  pole  of  the  end  effector, 
and  obstacles  are  repulsive  surfaces  for  the  manipulator  parts.  Controlling  a  given  point 
of  the  manipulator  with  respect  to  several  obstacles  is  resolved  directly  by  the  addition  of 
the  relevant  potentials. 

An  experimental  manipulator  programming  system  “COSMOS*  (Control  in  Opera¬ 
tional  Space  of  a  Manipulator-with-Obstacles  System)  has  been  designed  for  implementa¬ 
tion  of  the  method  for  PUMA  arms.  Demonstration  of  motions  with  obstacles  (including 
mobile  obstacles)  detected  by  an  MIC  (Machine  Intelligence  Corporation)  vision  module 
have  been  performed,  Fig.  6. 

Assembly  Robot  Tools  and  Subsystems 

A  dynamic  simulator  was  implemented  by  Burdick.  The  simulator  has  been  used  in 
verifying  analyses  of  control  algorithms,  and  in  Burdick’s  estimation  of  inertia  and  friction. 
The  simulator  is  essentially  a  software  equivalent  of  a  robot  arm.  The  simulator  takes  in 


torque  commands  from  a  control  system  program,  and  integrates  the  dynamic  equations 
of  motion  (which  are  developed  using  Lagrangian  mechanics)  to  yield  joint  accelerations, 
velocities,  and  positions.  The  simulator  is  currently  set  to  simulate  the  PUMA  560  robot, 
since  most  of  the  experimental  work  in  controls  at  Stanford  uses  this  robot. 

An  interactive  graphics  package  was  developed  to  plot  the  data  generated  from  sim¬ 
ulation.  Involving  the  human  mind  to  find  patterns  in  visual  data  greatly  improves  the 
quality  and  efficiency  of  the  data  analysis.  So  far,  the  simulator  has  been  used  to  test  three 
adaptive  control  schemes,  several  dynamic  control  schemes,  and  two  parameter  estimation 
schemes  —  with  considerable  time  saving  as  compared  to  implementing  and  debugging 
these  schemes  on  a  real  robot  arm. 

A  new,  nonlinear,  and  generalisable  technique  has  been  developed  that  will  contin¬ 
ually  monitor  the  parameters  of  a  robot  arm  and  update  them  as  they  change  during 
operation.  The  technique  measures  the  amount  of  torque  applied  during  operation  and 
tracks  the  robot’s  response  to  the  input.  Using  the  errors  between  the  actual  and  desired 
trajectory  and  a  general  nonlinear  model  of  the  robot  arm,  the  estimation  scheme  updates 
the  parameter  values.  The  technique  has  been  successfully  applied  to  a  physical  single  link 
robot. 

Another  technique  has  also  been  developed  to  estimate  continuously  the  friction  in 
robot  joints.  The  system  has  been  simulated  for  a  three-link  robot,  and  has  been  success¬ 
fully  applied  to  a  physical  single  link  robot  as  well. 

Inspection  and  Vision 

Research  in  vision  has  a  focus  on  intelligent  systems  which  support  not  only  inspection 
and  vision  but  the  total  robotics  and  manufacturing  research  program.  Contributions  have 
been  made  toward  a  successor  for  ACRONYM,  an  intelligent  system  developed  at  Stanford 
and  adopted  by  about  a  dosen  laboratories  and  companies  (Brooks  82). 

Work  has  been  carried  out  in  other  areas  of  computer  vision,  including  architecture  of 
VLSI  vision  processors,  segmentation  with  edge  operators,  graphic  support,  and  hardware 
support. 

Work  on  extending  ACRONYM  and  developing  SUCCESSOR  has  included  several 
projects.  A  geometric  editor  has  been  designed  and  implemented  by  Rublee.  Parts  of  the 
modeling  system  of  SUCCESSOR  have  been  designed  and  initial  implementation  has  been 
begun  by  Cowan.  The  modeling  system  is  greatly  generalized  over  ACRONYM  to  include 
multiple  naming,  holes  and  set  operations  on  volumes  (union,  intersection,  difference). 
Binford,  Brooks,  Triendl,  Dreschler,  and  Takamura  are  involved  with  the  system  and 
design  of  this  system  were  done  under  other  support. 

Implementation  of  a  new  edge  operator  is  being  done  by  TYiendl.  Lim  has  made  tests 
of  shape  from  a  shading  algorithm  by  Pentland  to  assess  its  suitability  for  integration 
in  ACRONYM  or  SUCCESSOR.  Wells  has  begun  design  and  experimentation  toward 
building  an  active  ranging  device. 

Both  software  and  hardware  support  for  vision  systems  have  been  provided.  They 
include:  software  for  interfacing  the  Grinnell  display;  LISP  graphics  by  Selker;  interface 


for  an  inexpensive  TV  input  system  by  Imaging  Technology  Inc.  by  Wells;  TV  time  base 
corrector  in  progress  by  Rousso;  an  interface  for  an  Optronics  drum  scanner  by  Fitshugh; 
work  on  software  for  a  GTCO  digitizing  tablet;  and  an  interface  for  an  image  hard  copy 
output  device. 

JED  is  an  interactive  geometric  model  editor  used  for  creating  and  editing  three 
dimensional  models  of  objects.  The  editor  allows  one  to  describe  and  display  a  wide  range 
of  generalised  cones  and  orient  these  primitive  shapes  to  form  more  complex  assemblies. 


Sensors  for  Robot  Systems 

New  sensors  will  of  course  be  extremely  important  components  of  new,  more  capable 
robots.  In  our  early  manipulator  research  we  are  using  simple  sensors  —  e.g.,  the  light- 
bulb/optical  sensor  shown  in  Fig.  5a  and  c  —  in  order  to  move  Thsk  3  forward  in  parallel 
with  the  development  of  new  sensors.  At  the  same  time,  in  Task  4  of  this  AFSOR  program 
and  in  other  projects,  we  are  also  sponsoring  and  collaborating  with  sensor  development 
efforts  per  se. 

The  sensor  system  described  under  Task  4  of  this  report  is  for  perceiving  by  touch, 
the  shape  or  texture  of  objects. 

Spatial  information  is  to  be  generated  by  an  array  of  capacitive  pressure  sensors,  each 
as  in  Fig.  7,  data  from  which  are  to  be  multiplexed  together  for  transmission  to  a  remote 
site.  Electrically,  a  bandwidth  of  1  -  500  Hz  and  a  response  time  <0.1  sec.  were  stipulated. 
Mechanically,  a  touch  sensor  must  provide  a  spatial  resolution  of  <  2  mm.,  and  must  be 
reliable,  easy  to  repair,  and  self-protecting. 

In  developing  such  a  touch  sensor,  such  sub-projects  include:  a)  an  electromechanical 
silicon  transducer,  b)  an  integrated  circuit  for  signal  processing  at  the  site  of  data  collection; 
c)  merger  of  electromechanical  transducer  and  the  on-rite  processing  circuitry  into  an 
hermetically  packaged  integrated  silicon  sensor;  d)  an  integrated  circuit  for  multiplexing 
signals  from  an  array  of  such  integrated  sensors;  and  e)  incorporation  of  the  integrated 
array  into  robotic  skin. 

During  the  first  year,  effort  has  focused  on  the  development  of  the  required  integrated 
sensors  and  circuits. 

A  capacitator  was  chosen  as  the  transduction  element  due  to  its  superior  sensitiv¬ 
ity  over  piezoresistive  pressure  sensors.  Special  micromachining  techniques  are  needed 
for  forming  this  structure,  including  chemical  etching,  laser  drilling  and  welding,  micro- 
sandblasting,  and  electrostatic  bonding.  An  automated  laser  workstation  for  microma¬ 
chining  glass  wafers  has  been  developed  and  used  to  produce  arrays  of  electrical  vias  for 
electrical  connection  between  cables  attached  to  the  top  of  the  glass  cap  and  the  integrated 
circuit  under  the  glass  cap.  In  addition,  a  set  of  photomasks  for  a  Mechanical  Test  Chip 
(MTCHIP)  was  laid  out. 

A  Mechanical  Test  Chip  was  then  designed  and  built  to  test  etching  techniques  for 
the  pressure  sensitive  silicon  diaphragm,  sand-blasting  and  laser  micromachining  of  the 
glass  wafer,  electrostatic  bonding  of  the  glass  and  silicon  wafers,  and  cable  connection  to 
the  device. 


1  -  ELECTRICAL  CONTACT  VIAS 

2  -  ELECTROSTATIC  SHIELD 

3  -  CUSTOM  INTEGRATED  CIRCUIT 

4  -  REFERENCE  CAPACITOR 

5  -  PRESSURE  5ENSING  CAPACITOR 


Signal  processing  and  output  format  required  for  the  integrated  capacitive  pressure 
sensor  were  designed  to  switch  the  oscillator  between  reference  and  pressure  sensitive 
capacitors.  In  addition  to  the  sensed  pressure,  the  circuit  also  produces  temperature, 
pressure  scale,  temperature  scale,  and  sero  reference  data,  which  provide  all  the  informa¬ 
tion  required  for  subsequent  signal  processing  circuitry  to  calculate  capacitance,  and  thus 
pressure,  independent  of  temperature  and  drifts  in  offset  or  gain. 

This  circuit  has  been  designed,  simulated,  breadboarded,  laid  out,  fabricated,  and 
tested.  A  photomicrograph  of  the  circuit  appears  in  Fig.  8.  Early  circuit  tests  showed 
the  system  to  be  fully  functional  but  more  sensitive  to  temperature  and  supply  voltage 
than  desired.  Therefore,  the  circuit  and  its  fabrication  process  were  refined  to  reduce 
these  dependencies  and  fabrication  variations.  Test  results  from  6  circuits  demonstrate 
that  temperature  is  measured  to  an  accuracy  of  ±0.1  degC.  As  a  result,  pressure  may  be 
measured  to  an  accuracy  of  ±0.7  mmHg  in  a  full  scale  of  300  mmHg 

In  applications  such  as  this,  which  require  many  sensors,  it  is  impractical  to  connect 
wires  to  each  sensor  individually.  A  significant  simplification  in  wiring  results  if  the  sensor 
output  signals  are  multiplexed  in  time.  A  Multisensor  Controller/Multiplexer  (MC/M) 
integrated  circuit  that  allows  the  output  terminals  from  many  silicon  sensors  to  be  fused 
together  is  currently  under  development.  This  integrated  circuit  which  will  fulfill  a  variety 
of  specifications,  has  now  been  designed  and  simulated,  first  block  by  block,  and  then  as 
an  integrated  system. 


TECHNICAL  REPORT 


TASK  1: 

SURVEY  OP  KEY  PROBLEMS  AND  TECHNOLOGY  TRANSFER 


In  the  first  phase  of  this  task  —  Survey  of  Key  Problems  —  we  have  investigated 
,  relevant  technology  based  on  the  experience  of  this  contract,  combined  with  fifteen  years 

of  work  preceding  it,  and  from  the  point  of  view  of  contacts  in  the  industry.  We  feel  a 
responsibility  to  summarize  these  observations  to  share  research  objectives. 

The  work  of  this  contract  is  in  the  perspective  of  the  broader  scope  of  advanced 
manufacturing  stations  for  aerospace  manufacturing  and  automation.  A  primary  issue  is 
»  development  of  integrated  technology  for  reconfigurable,  programmable  automation.  The 

program  for  implementation  of  integrated  technology  includes  necessary  component  tech¬ 
nology  and  the  integration  technology  to  make  possible  the  building  of  complex,  integrated 
systems.  Figure  1-1  shows  this  goal  structure.  Inspection  and  robotics  in  assembly  are 
among  the  most  advanced  problems  driving  evolution  of  this  aspect  of  programmable  au- 
,  tomation,  which  impacts  all  areas  of  manufacturing. 

The  goals  of  component  technology  are  to  make  robots  and  machines  with  higher 
performance  at  a  better  performance  to  coet  ratio,  to  implement  new  capabilities  which 
expand  their  work,  and  to  make  them  more  programmable  by  requiring  less  fixturing,  less 
preparation  and  less  control  of  the  work  environment,  by  requiring  less  information  to 
i  specify  tasks  and  the  environment,  and  by  implementing  modular  component  technology. 

This  perspective  suggests  priorities  among  modular  component  technologies: 

1.  Adaptation  to  External  and  Internal  Uncertainties: 

In  T^sk  3  we  develop  technology  for  compensation  and  for  adaptation  to  flexibility 
of  drive  trains,  structures,  mountings,  end  effectors,  and  loads,  and  for  adaptation  to 
load.  Methods  also  are  developed  for  continuous  system  estimation  and  adaptation 
to  changes  in  configuration. 

2.  Sensory  Control: 

In  Task  3  we  include  the  use  of  end-point  sensing  in  control.  In  related  work  funded 
under  other  contracts,  technology  is  being  developed  for  using  contact  sensors  (force 
and  touch  sensors)  to  control  compliance  and  exerting  of  forces  in  task  coordinates  for 
six  degrees  of  freedom  manipulators.  An  aspect  of  that  research  is  force  strategies  in 
parts  mating,  both  open  loop  and  feedback  strategies.  That  work  has  developed  new 
methods  for  stability  at  contact,  at  the  transition  from  position  and  velocity  control 
to  force  control.  Visual  control  of  motion  was  demonstrated  in  collision  avoidance  in 
Task  2.  Fine  motion  under  sensory  control,  especially  using  small  motion  devices  such 
as  the  wrist  of  Task  3b.,  demonstrates  speed  and  accuracy. 

3.  Cooperation  Among  Manipulators: 

The  quick  wrist  of  Task  3b.  explores  coordinated  coarse-  and  fine-motion  strategies. 
Work  is  underway  in  two  arm  cooperation.  Work  under  other  support  deals  with  three 
finger  hands  which  require  coordination  of  nine  degrees  of  freedom.  To  summarize,  in 
the  area  of  manipulation,  we  have  come  to  believe  that  among  technologies  that  will 
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enable  the  next  major  steps  for  industrial  robots,  the  following  are  of  key  importance: 
end-point  feedback  control  that  is  robust  and  capable  of  achieving  high  bandwidths 
despite  manipulator  flexibility;  simultaneous  control  of  end-point  force  and  position; 
high-level  control  of  intimately  cooperating  manipulators;  concerted  use  of  quick  local 
manipulators  carried  by  much  larger,  possibly  very  flexible  manipulators;  real-time 
adaptive  control  that  is  fast  enough,  and  sufficiently  insensitive  to  noise  to  be  of  prac¬ 
tical  use.  These  are  the  areas  in  which  we  have  been  concentrating  our  experimental 
efforts  in  Task  3  of  this  AFOSR  program,  and  in  some  other  programs  as  well. 

4.  Sensory  Technology: 

In  Tisk  4  development  of  integrated  circuit  sensors  has  stressed  providing  system 
integration  capability  for  arrays  of  sensors,  especially  signal  processing  and  encoding 
and  multiplexing  of  signals  to  minimize  interfacing  difficulties.  Other  work  under 
DARPA  funding  dealt  with  implementing  tactile  arrays  for  tasks  with  the  three  finger 
hand. 

5.  Inspection  and  Vision: 

Inspection  technology  is  likely  to  have  as  big  an  impact  as  robots  over  a  very  wide 
domain  of  manufacturing.  In  Task  2,  we  have  built  up  mechanisms  for  incorporation 
in  vision  systems. 

6.  Manufacturing  Technology: 

Under  other  support,  Professor  DeBra  is  building  a  diamond  turning  machine  incor¬ 
porating  a  novel  laminar  flow  hydraulic  motor. 

7.  Mobility: 

Especially  in  airframe  production  and  machining  centers,  a  robot  can  work  over  a 
large  space,  e.g.,  loading  and  unloading  parts  for  a  variety  of  machines,  or  working  on 
large  airframe  parts.  Methods  for  incorporating  mobility  into  the  manipulation  and 
control  are  under  development. 

Integration  Technology  includes  those  disciplines  necessary  to  build  large,  complex 
systems.  Traditional  computer  science  and  artificial  intelligence  are  key  elements.  The  ob¬ 
jectives  are  to  provide  the  science  base  for  integrating  modular  component  technology  into 
workstations,  for  integrating  automation  workstations  into  work  cells,  the  next  higher  level 
of  structure  in  manufacturing,  and  to  link  workstations  to  users.  The  components  them¬ 
selves  are  complex  subsystems.  Their  integration  involves  multiple  sensors  and  multiple 
information  sources. 

These  integration  technology  elements  are: 

1.  Programming  Systems: 

Software  technology  is  perhaps  the  technology  with  the  most  potential  impact  in 
automation.  In  Task  2  we  devoted  a  small  effort  to  a  system  for  conventional  ex¬ 
plicit  programming  of  motions  and  substantial  effort  to  automating  programming  and 
concentrating  the  human  interface  on  building  models.  A  small  effort  advanced  de¬ 
velopment  of  the  AL  system  for  programming  robots. 

It  is  highly  developed  now  and  beginning  to  be  integrated  with  the  hand  and  with 
COSMOS,  the  force  control  system. 


2.  Task  Planning: 

Task  planning  can  be  thought  of  as  highly  advanced  methods  for  programming  sys¬ 
tems.  In  Task  2,  a  preliminary  version  of  ATLAS  is  reaching  the  stage  of  planning 
tactile-controlled  fine  motion.  Work  on  SUCCESSOR  involves  several  aspects  of  au¬ 
tomated  task  planning.  In  work  under  DARPA  support,  task  decomposition  with  the 
three  finger  hand  provides  high  level  task  primitives. 

3.  Geometric  Reasoning: 

The  basis  for  integrating  modules  is  a  thorough  program  to  express  everything  in 
the  system  in  terms  of  geometry,  based  on  geometric  representation,  building  generic, 
symbolic  geometric  models  for  object  classes,  representation  of  geometric  constraints, 
models  of  sensors  and  operators,  and  modeling  and  prediction  for  surface  proper¬ 
ties,  especially  specularity.  Inference  rules  and  quasi-invariants  provide  new  generic 
interpretation  methods  along  with  generic,  symbolic  prediction. 

Analysis  of  computational  complexity  and  strategies  for  efficient  execution  provide 
the  basis  for  integrating  sequences  of  operations. 

4.  Knowledge  Base 

Building  up  the  knowledge  base  for  intelligent  systems  is  regarded  as  a  major  problem 
within  the  AI.  Learning  is  one  aspect  of  building  knowledge  bases.  Our  previous  work 
has  dealt  with  learning  the  relation  between  structure  and  function  in  defining  object 
classes.  Geometric  representation  and  generalisation  are  central  issues  here. 

The  second  phase  of  this  task  —  Technology  Transfer  —  has  been  carried  out  in 
two  parts;  first,  technology  transfer,  and  second,  setting  up  mechanisms  for  sustained 
interaction  with  industry  personnel  concerning  industrial  applications  and  technology  op¬ 
portunities. 

The  Center  for  Automation  and  Manufacturing  Science,  CAMS,  was  set  up  under 
support  of  this  contract,  with  Professors  Cannon  and  Binford  as  co-directors.  CAMS 
encompasses  research  in  sensory  robotics,  computer  vision  and  planning,  manipulation  for 
precision  manufacturing,  precision  machining,  sensory  technology,  and  related  technology 
topics. 

Subsequently,  SIMA,  the  Stanford  Institute  for  Manufacturing  and  Automation  was 
formed.  Professor  Cannon  serves  as  Chairman  of  the  SIMA  Steering  Committee.  CAMS 
is  one  of  four  centers  in  SIMA.  The  others  are:  CDR,  Center  for  Design  Research,  which 
focuses  on  the  interaction  between  the  designer  and  the  system;  CMFPS,  the  Center  for 
Materials  Formability  and  Processing  Science,  which  investigates  advanced  processes  for 
materials  forming;  and  CTRIMS,  the  Center  for  Teaching  and  Research  in  Manufacturing 
Systems,  which  offers  a  master’s  degree  program  in  manufacturing  systems  management 
and  conducts  research  in  manufacturing  management.  SIMA  brings  together  the  centers 
and  industry  sponsors.  Two  special  mechanisms  appear.  The  SIMA  industrial  advisory 
board  meets  twice  a  year.  The  board  is  made  up  of  the  principal  responsible  person  for  each 
corporation,  typically  a  vice  president.  They  are  having  a  major  effect  on  SIMA  policy. 
They  also  are  helping  to  establish  contact  between  technical  people  in  their  organizations 
and  centers  within  SIMA.  This  will  provide  valuable  guidance  to  our  university  research  and 
teaching  in  manufacturing,  facilitate  transfer  of  the  technology  we  develop,  and  connect  our 
manufacturing  graduates  with  industrial  career  opportunities  (by  far,  the  most  effective 


means  for  technology  transfer).  It  will  likely  lead  to  specific  contracts  on  topics  of  mutual 
interest.  The  current  corporate  members  of  SIMA  are  Apple,  Boeing,  FMC,  Ford,  General 
Electric,  General  Motors,  Hewlett  Packard,  IBM,  Lockheed,  McDonald  Douglas,  Sperry 
and  3M. 

Specific  technology  transfer,  the  other  half  of  this  task,  has  already  made  an  impact. 
A  major  area  has  been  transfer  of  force  control  technology.  Initially,  under  the  Intelligent 
Task  Automation  project  (ITA),  Adept  Technology  implemented  our  old  force  control 
technology,  the  Salisbury  system.  Subsequently,  they  have  been  developing  techniques 
based  on  our  current  force  control  system  in  task  space,  by  Khatib. 

A  major  part  of  technology  transfer  is  through  research  personnel.  A  total  of  about  10 
students  from  GAMS  have  joined  companies  in  this  area  of  technology,  including  Adept, 
ADS,  Boeing,  Hughes,  IBM,  Martin  Marietta,  and  SRI. 

The  Common  Lisp  development  which  supports  our  work  in  intelligent  systems  has 
been  commercialised.  Lucid  Common  Lisp  is  based  on  our  implementation  of  TAIL,  a 
Common  Lisp  for  the  SUN.  The  commercial  version  is  attracting  much  attention  on  SUN 
3  workstations  and  promises  to  be  a  low  cost  LISP  workstation  with  good  performance. 

The  ACRONYM  system  has  been  ported  by  a  dosen  or  more  laboratories  and  recently 
a  handful  of  new  requests  have  appeared.  It  is  now  being  distributed  both  by  the  DARPA 
Image  Understanding  Testbed  and  by  the  Software  Distribution  Center  at  Stanford  on  a 
very  low  cost  basis. 

The  AL  system  has  affected  the  design  of  robot  programming  languages  substantially. 
Copies  have  been  made  at  Grenoble,  France,  at  Karlsruhe,  Germany,  and  at  Tokyo.  AL 
has  had  a  very  strong  influence  on  standardisation  efforts  for  robot  programming  systems. 
Several  companies  have  programming  systems  which  look  very  much  like  AL:  Hitachi 
Production  Engineering  Lab,  Matsushita,  ITMI,  and  Hewlett  Packard.  However,  it  has 
been  difficult  to  find  support  for  AL  development  in  the  USA. 

We  have  now  close  contact  with  a  number  of  companies,  both  long  term  relations 
and  recently  initiated  ties  through  SIMA.  Special  relations  are  ongoing  with  Adept,  ADS, 
Apple,  Boeing,  FMC,  Ford,  General  Electric,  General  Motors,  Hewlett  Packard,  Honeywell, 
IBM,  Lockheed,  Martin  Marietta,  McDonald  Douglas,  and  3M. 
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TECHNICAL  REPORT  ON  TASK  2: 

INTELLIGENT  SYSTEMS  FOR  MANUFACTURING;  INSPECTION  AND  VISION 
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Overview 

Throughout  computer  science,  the  programming  problem  is  dominant.  This  is  also 
true  of  programming  robots  and  other  programmable  automation.  For  robot  tasks  which 
seem  simple  to  program  at  the  high  level  of  specifying  how  parts  fit  together,  in  spec¬ 
ifying  detailed  programs  required  by  existing  robots,  programs  expand  through  several 
substantial  levels  of  program  length  and  complexity.  In  the  second  year  of  this  contract, 
the  ATLAS  system  was  undertaken  to  investigate  general  methods  for  programming  at 
this  high  level  of  fitting  parts  together.  Design  and  implementation  of  ATLAS  included: 
1)  a  simple  geometric  model  representation  of  a  small  set  of  generalized  cylinders;  2)  a 
task  specification  module  with  representations  of  assembly  graphs,  constraints,  and  un¬ 
certainty;  and  3)  a  skeleton  matcher  which  decomposed  tasks  into  a  graph  of  component 
operations,  identified  constraints,  and  inferred  goal  positions.  The  current  work  in  ATLAS 
is  in  two  parts,  1)  synthesising  fine  motions  when  canned  routines  are  inadequate,  ahd  2) 
integrating  a  constraint  solver.  We  plan  to  couple  ATLAS  as  a  program  generator  to  the 
Cosmos  force  control  system  for  robots  to  plan  fine  motion  tasks  for  real  robots. 

In  our  work  on  intelligent  systems,  software  portability  is  a  major  concern.  Progress 
was  made  toward  development  of  a  practical  Common  Lisp  for  small  machines.  This  work 
led  to  a  commercial  implementation  which  has  high  initial  technical  reviews.  Separately, 
a  real-time  garbage  collection  algorithm  was  created. 

In  work  under  other  support,  the  Intelligent  Thsk  Automation  project  (ITA),  the 
intelligent  system  ACRONYM  was  extended  and  tested  in  recognition  of  15  industrial 
parts.  This  experiment  and  analysis  led  to  major  criteria  for  the  next  system,  SUC¬ 
CESSOR.  Under  this  AFOSR  contract,  extensions  to  the  modeling  system  were  designed; 
those  extensions  bring  implemented  include:  adding  surface  models  and  surface  markings; 
implementing  intersection  for  combining  primitives  by  set  operations;  and  automated  gen¬ 
eration  of  polyhedral  approximation  to  generalized  cylinder  primitives.  In  the  second  year, 
a  model-building  program  was  implemented  which  a  user  could  learn  to  operate  in  one  hour 
and  build  models  in  fifteen  minutes. 

For  the  intelligent  system,  extensive  work  was  done  for  prediction.  In  the  ITA  exper¬ 
iments,  including  more  image  features  became  important,  especially  specularity.  Analysis 
and  experimentation  were  performed  to  relate  specularities  to  intrinsic  surface  properties, 
i.e.,  orientation  and  curvature.  Substantial  results  show  prediction  of  image  specularity 
features  from  models  and  estimation  of  surface  properties  from  images.  Symbolic  graphics 
of  image  features,  i.e.,  symbolic  edges  and  vertices,  was  analyzed  and  implemented  for  a 
large  subset  of  generalized  cylinder  primitives  and  partially  implemented  for  compound 
objects  made  of  these  primitives.  These  methods  are  relevant  for  recognizing  individual 
objects  in  fixed  positions. 

Under  this  AFOSR  support  in  the  third  year  we  have  extended  the  earlier  work  in 
important  ways.  To  extend  prediction  to  a  variety  of  sensors  and  multi-sensor  tasks,  anal¬ 
ysis,  design,  and  implementation  have  proceeded  toward  a  system  to  incorporate  models 


of  sensors  and  perceptual  algorithms,  to  make  predictions  for  images  and  measurements, 
and  to  determine  effective  strategies  for  sensor-based  tasks. 

Theoretical  work  has  led  to  a  generic  observability  model  for  visual  perception  in  the 
visible  spectrum.  This  provides  a  firm  basis  for  prediction  and  for  interpretation  of  image 
data.  Related  work  defines  methods  for  predicting  and  estimating  metric  properties  of 
objects,  quasi-invariants  which  are  insensitive  to  viewpoint  or  object  class. 

During  the  first  year  of  the  contract  work  was  done  on  programming  systems  for 
sensory  robots.  Substantial  development  was  performed  on  the  AL  system,  especially  in 
the  user  interface,  i.e.,  structure  editor  and  debugger,  graphics,  and  voice  synthesiser.  New 
motion  commands  were  added  and  commands  for  reading  forces  in  arbitrary  coordinate 
systems.  A  distributed  version  of  AL  was  implemented.  Since  that  time,  under  other 
support,  AL  has  been  extensively  debugged,  a  VAX  version  has  been  implemented,  and 
extensions  have  been  added  for  three  finger  hand  and  other  sensor-controlled  capabilities. 

Also  during  the  first  year,  the  COSMOS  system  was  extensively  developed.  One 
portion  of  the  work  was  development  of  a  collision  avoidance  scheme  based  on  fictitious 
repulsive  potentials  around  obstacles.  Substantial  analytic  improvements  Were  made,  cul¬ 
minating  in  a  solution  for  the  entire  arm  as  a  set  of  extended  links.  This  method  makes 
use  of  force  control  using  fictitious  and  actual  forces.  Its  development  was  coupled  to  that 
of  force  control  in  the  COSMOS  system.  Thus,  this  work  contributed  also  to  substantial 
improvements  in  force  control.  Under  subsequent  ITA  support  and  NSF  support,  force 
control  was  extended  to  make  dramatic  performance,  e.g.,  the  control  of  forces  of  about 
15  gms,  an  improvement  from  200  gms  previous  force  control  level. 

Assembly  Planning 

ATLAS  —  Automatic  Task  Level  Assembly  Synthesizer  —  is  a  developing  system  for 
automated  robot  programming.  Building  application  programs  for  robots  is  typical  of  the 
massive  software  problem  which  users  face  with  modern  computer-based  technology.  The 
software  problem  is  accentuated  by  the  difficulty  of  robotics  and  the  special  knowledge 
required.  In  this  effort,  we  investigate  automatic,  model-based  generation  of  programs. 
ATLAS  is  intended  to  synthesize  sensor-based  programs  from  high  level  specifications, 
e.g.,  instructions  at  the  level  of  an  assembly  manual.  Task  level  planning  *im«  to  simplify 
the  task  of  the  user  in  specifying  only  goals  for  how  parts  fit  together,  physical  relationships 
among  objects,  not  the  motions  of  machines  to  achieve  those  goals.  This  is  natural  and 
compact  to  specify  for  users  and  CAD  systems,  in  contrast  to  programming  robot  motions. 
A  task-level  specification  is  intended  to  be  robot-independent. 

ATLAS  integrates  the  planning  operations  involved  in  building  programs.  A  user 
specifies  a  task,  e.g.,  attaching  a  lid  to  a  box  with  four  screws: 

Place  LID  on  BOX  (against  (BOTTOM-FACE  LID)  (TOP-FACE  BOX)) 

Tighten  BOLTl  (into  (HOLEl  BOX)  (HOLE1  LID)) 

Tighten  BOLT2  (into  (HOLE2  BOX)  (HOLE2  LID)) 

Tighten  BOLT3  (into  (HOLE3  BOX)  (HOLE2  LID)) 

Tighten  BOLT4  (into  (HOLE4  BOX)  (HOLE2  LID)) 


The  task  specification  is  used  to  generate  an  Assembly  Graph  which  represents  physi¬ 
cal  states  with  objects  as  nodes  and  interactions  as  links.  Links  are  time-tagged  to  indicate 
when  they  are  valid.  Objects  interact  by  contact  relations  among  features,  i.e.,  surfaces, 
edges,  and  points  of  one  object  against  those  of  another.  Interactions  may  be  first  order, 
involving  a  single  feature  from  each  object,  or  they  may  be  higher  order.  Relations  can  be 
categorized  by  their  residual  degrees  of  freedom. 

The  task  planner  expands  the  task  into  planning  elements:  parts  feeding,  layout, 
fixturing,  grasping,  coarse  motion,  and  fine  motion.  The  task  planner  generates  a  sequence 
of  nominal  operations  like  placing  the  box  and  placing  the  lid  on  the  box.  This  sets  up  a 
constraint  on  the  location  of  the  lid  relative  to  the  box;  the  bottom  surface  is  against  the 
top  surface  of  the  box.  Inserting  bolt  1  into  hole  1  of  lid  and  hole  1  of  box  imposes  another 
constraint,  that  hole  1  of  lid  is  aligned  with  hole  1  of  box,  a  constraint  on  the  location  of 
the  lid  relative  to  the  box.  The  same  is  true  for  inserting  the  other  three  bolts. 

If  we  expand  the  program  to  include  robot  motions,  each  step  expands  into  about  six 
motions.  For  each  motion,  a  path  must  be  calculated  from  positions  of  parts.  The  assembly 
will  probably  be  unsuccessful  because  of  uncertainties  in  positions  and  dimensions  of  parts. 
Typical  robot  programs  expand  a  factor  of  five  to  ten  in  incorporating  contingent  actions, 
in  analyzing  sensor  results,  in  specifying  sensor  states  and  strategies  in  sensor-controlled 
fine  motion,  or  in  using  fixturing.  In  addition,  data  base  references  and  calculations  expand 
programs  greatly.  What  was  a  simple  program  at  the  high  level  becomes  more  difficult  and 
more  technical  at  the  level  of  robot  motions.  It  becomes  very  difficult  and  very  technical 
when  uncertainties  and  contingencies  must  be  included,  as  they  almost  always  must  be. 
These  are  the  steps  that  ATLAS  aims  to  automate. 

As  we  saw,  each  step  of  the  task  imposed  constraints  on  relative  locations  of  parts. 
Different  steps  interact  because  they  impose  different  constraints  on  the  same  variable, 
e.g.,  each  bolt  puts  a  constraint  on  the  location  of  the  lid  relative  to  the  box. 

There  are  many  uncertainties  in  task  environments,  i.e.,  uncertainties  in  part  di¬ 
mensions,  in  feeders  and  fixtures,  in  manipulators,  and  in  sensors.  Uncertainties  can  be 
analyzed  to  model  the  task  environment,  they  can  be  designed  to  be  small,  they  can  be 
corrected  by  sensing  and  fine  motion.  They  must  be  represented  and  dealt  with  in  this 
system. 

A  high  level  task  specification  module  was  developed.  It  included  PLACE  with  con¬ 
straint  AGAINST  and  INSERT  (cylinder)  with  constraint  relation  INTO.  A  simple  geo¬ 
metric  modeler  was  developed  which  included  circular  cylinders  and  blocks,  implemented 
as  a  small  subclass  of  generalized  cylinders.  The  assembly  graph  representation  was  devel¬ 
oped.  Constraints  on  uncertainties  were  developed.  Operations  in  task  specifications  were 
decomposed  into  a  set  of  skeleton  operations  which  were:  1)  Gross  motion;  2)  Grasp;  3) 
Ungrasp;  4)  Bolt  in  hole;  S)  Stacking:  vertical  align  without  sensing;  6)  Synthesized  Fine 
Motion.  Bolt  in  hole,  stacking,  and  synthesized  fine  motion  are  all  called  fine  motion  op¬ 
erations.  A  module  called  the  skeleton  matcher  was  implemented.  It  acted  to:  1)  identify 
which  skeleton  operations  were  needed;  for  example,  INSERT  involves  gross  motion,  grasp, 
gross  motion,  bolt  in  hole,  ungrasp;  2)  infer  the  goal  position  for  each  operation;  3)  identify 
applicability  constraints  for  use  of  the  operations  and  identify  constraints  which  must  be 
propagated;  4)  build  up  the  graph  of  skeleton  operations;  5)  identify  time  of  operations, 
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using  one  time  unit  per  operation;  6)  find  all  interactions  among  constraints  on  the  current 
object. 


The  current  work  in  ATLAS  is  in  two  parts,  1)  fine  motion  synthesis,  and  2)  integrating 
a  constraint  solver. 


Fine  Motion  Synthesis 


The  use  of  active  compliances  enables  a  robot  to  execute  tasks  under  uncertainty. 
Compliant  motions  are  difficult  to  program  or  specify.  The  geometry  required  is  detailed, 
force  strategies  are  complex  and  require  specialised  knowledge,  and  programming  effort  is 
large.  These  factors  make  automatic  fine  motion  synthesis  an  important  part  of  automatic 
robot  programming. 


[Losano-Peres  83]  discussed  factors  of  uncertainty  and  friction  and  used  a  pre-image 
method  of  backward  chaining  for  synthesis  of  fine  motion  programs.  They  subsumed  the 
work  of  [Mason  81]  on  hybrid  position  and  force  control  for  the  motion  of  bodies  under 
contact. 


As  a  tool  for  automatic  synthesis  of  hybrid  control  strategies,  the  freedom  of  bodies 
under  contact  has  been  related  to  their  C- spaces  using  screw  theory.  One  of  the  bodies 
represented  as  a  point  can  contact  the  C-space  of  the  other  body  under  configurations 
that  have  different  natural  position  constraints.  A  sensed  change  in  position  constraints 
carries  information  about  the  state  of  the  object  and  the  manipulator.  This  information 
is  used  to  restrict  the  set  of  possible  positions  under  sensor  uncertainty.  The  change  is 
also  used  as  a  guard-condition  for  shifting  the  control  strategy  for  a  different  geometrical 
configuration.  The  nodes  in  the  *reachability  graph”  from  [Losano-Peres  83]  correspond 
to  a  point  body  touching  one  feature  of  the  C-space.  Each  of  those  nodes  corresponds  to 
many  nodes,  each  corresponding  to  different  freedoms  of  motion  between  the  bodies.  A 
program  to  implement  the  strategy  is  in  progress. 


Constraint  Solver 


Constraints  are  propagated  between  plan  steps.  Initially  plan  steps  are  modeled  by 
instantiated  plan  skeletons  and  later  refined  into  more  detail.  Constraint  propagation 
continues  as  the  plan  steps  are  refined,  propagating  the  inter-relating  constraints  back  and 
forth  between  plan  steps.  Thus,  each  plan  module  acts  as  a  generator  of  success/restriction 
pairs.  As  it  is  re-invoked  it  generates  another  solution  or  eventually  fails. 


The  basic  constraint  solver  has  now  been  provided  with  “generator”,  “escape-generator”, 
“try- next”,  and  “add-possibility”  macros  to  implement  the  generator-iterator  environment. 


To  keep  track  of  the  associations  of  constraints  and  the  corresponding  modules  that 
introduce  each,  each  set  of  constraints  is  tagged  to  the  frame  that  it  belongs  to.  The 
generators  are  in  fact  local  to  the  frames.  Supporting  macros  to  create  frames,  associate 
variables  with  each  frame,  pop  and  flush  frames  have  been  created.  These  are  the  “con¬ 
straint  posting*  functions. 


Assembly  and  Sab-assembly  Inference 

As  a  part  of  intelligent  inference  from  task  level  specification,  a  tool  is  required  to 
infer  that  a  subset  of  components  in  the  assembly  is  a  sub-assembly.  Such  sub-assemblies 
can  be  assembled  independent  of  the  main  assembly  and  transported  to  the  main  assembly 
position. 

This  problem  has  been  posed  as  a  sub-graph  search  problem.  The  essential  tool  to 
search  the  graph  using  the  screw  theory  of  “form-closure*  has  been  studied.  We  do  not 
know  about  the  complexity  of  its  computation. 

Plans 

We  plan  to  implement  fine  motion  synthesis  as  a  program  generator  for  the  COSMOS 
system  developed  at  Stanford.  COSMOS  has  position  and  force  control  in  task  space  which 
is  required  to  carry  out  the  fine  motion  operations  dictated  by  the  planning  system. 

Common  Lisp  Development 

A  major  aim  in  system  development  was  portability  of  software.  Hardware  is  evolving 
rapidly;  this  provides  an  opportunity  to  move  to  systems  with  better  performance  or  cost. 
Hardware  evolution  provides  a  risk  of  being  tied  to  obsolete  hardware.  Hardware  avail¬ 
ability  has  changed  substantially  over  the  life  of  this  project  and  will  evolve  dramatically 
over  the  life  of  a  major  software  system.  Software  is  the  major  investment  in  a  computer 
system,  typically  estimated  at  90%  of  the  cost.  From  these  considerations,  it  was  decided 
to  tie  our  work  in  intelligent  systems  to  Common  Lisp. 

A  subset  of  Common  Lisp  called  SLisp  was  defined  and  implemented  in  Frans  Lisp  on 
VAX  systems.  SLisp  has  been  used  during  the  last  two  years  in  much  of  our  work.  It  has 
meant  that  moving  programs  from  the  VAX  to  Common  Lisp  has  been  simplified.  SLisp 
was  used  by  some  researchers  at  AI&DS,  a  local  AI  company,  in  their  work. 

A  version  of  Common  Lisp,  TAIL,  was  developed  for  SUN  workstations.  It  has  been  a 
major  success.  A  company,  Lucid,  Inc.,  was  formed  to  develop  and  market  Common  Lisp 
systems  including  personnel  who  worked  on  TAIL.  Lucid  Common  Lisp  is  now  available  on 
SUN  3  workstations  which  are  attracting  attention  as  high  performance  Lisp  workstations 
at  a  $25,000  cost.  This  may  expand  the  contribution  to  the  research  of  others  that  our 
own  internal  development  could  not  make.  Lucid  Common  Lisp  has  strong  roots  in  TAIL. 
Technical  advances  in  the  TAIL  compiler  included:  1)  enhanced  portability  including  a  ma¬ 
chine  independent  code  generation  strategy;  2)  improved  code  optimisation  and  relatively 
efficient  implementation;  and  3)  operating  system  portability  in  window  systems. 

A  new  algorithm  for  real-time  garbage  collection  was  developed  which  supports  Lisp 
i j  stems  for  robotics  (Brooks  84].  This  algorithm  has  significant  performance  advantages 
in  implementing  real-time  garbage  collection  on  ordinary  computers  like  the  68000  with 
moderate  cost  in  computation  time  and  storage.  Previous  algorithms  have  large  overhead 
on  ordinary  computers  and  required  special  hardware  for  efficient  implementation. 


Model-based  Intelligent  Systems  For  Inspection  and  Vision 

The  new  model-based  intelligent  system  is  intended  to  generalize  over  the  previous 
system,  ACRONYM,  to  provide  enhanced  performance,  greater  speed,  and  to  be  more 
usable  by  other  groups. 

It  will  implement  a  much  richer  class  of  models: 

a)  more  powerful  generalized  cylinder  primitives; 

b)  boolean  set  operations  (union,  intersection,  set  difference); 

c)  joints  between  primitives; 

d)  merge  surface  and  volume  representations  in  painted  surfaces. 

It  will  incorporate  more  powerful  symbolic  predictions: 

a)  specularity  and  shading; 

b)  generic  observability  models; 

c)  models  for  sensory  and  vision  operators; 

d)  expanded  features  and  quasi-invariants; 

e)  hierarchical,  structured  prediction  graphs. 

It  will  integrate  more  capable  symbolic  observations  from  segmentation/aggregation 
operators  and  stereo  vision. 

It  will  introduce  extended  interpretation  and  matching  of  models  with  observation 
using: 

a)  coarse-fine  models  and  matching; 

b)  strategies  for  matching; 

c)  hierarchical,  structured  matches. 

Geometric  Models 

Geometric  models  are  represented  by  compound  volumes  and  surfaces  which  are 
formed  from  primitive  parts,  generalized  cylinders,  combined  into  structures  by  set  op¬ 
erations,  i.e.,  union,  intersection,  and  set  difference.  An  algorithm  is  under  development 
by  Chien  to  calculate  the  key  operation,  intersection,  for  a  rich  class  of  generalized  cylinder 
primitives. 

A  key  aspect  is  to  make  symbolic  approximations  for  intersections  in  order  to  make 
generic  prediction,  to  support  geometric  reasoning,  and  to  calculate  intersections  to  arbi¬ 
trary  accuracy  of  approximation.  Curves  and  surfaces  of  intersection  are  characterized  by 
analytical  basis  functions  locally  to  whatever  approximation  is  required  and  are  character¬ 
ized  globally  as  splines  with  knots  at  discontinuities  and  other  knots  without  discontinuities 
elsewhere  as  necessary. 

Chien ’s  algorithm  uses  methods  of  computatioral  geometry  to  determine  approximate 
intersection  edges,  surfaces,  and  volumes.  Its  volume  representation  is  a  volume  tree,  an 
oct-tree  with  spherical  cells,  its  surface  representation  is  a  net  of  vertices,  planar  faces, 
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and  edges,  and  its  edge  representation  is  a  rope  of  vertices  and  straight  line  segments. 
Surface  and  edge  representations  are  first  order  splines  which  are  initial  approximations 
for  iterative,  analytic  solutions  for  higher  order  splines. 

For  the  intersection  of  volumes  A  and  B,  intersection  curves  are  the  intersections  of 
their  boundary  surfaces  dA  and  dB.  In  the  volume  tree,  these  are  the  joint  boundary 
cells  of  A  and  B,  which  are  grey  cells  for  both  A  and  B.  They  are  starting  places  for 
iterating  to  points  on  boundary  curves.  The  hierarchical  volume  structure  enables  efficient 
computation.  Refined  estimates  for  boundary  points  are  intersections  of  edges  of  one 
surface  with  faces  of  the  other.  An  iteration  approximates  points  on  boundary  curves 
to  desired  accuracy.  Appendix  C  describes  the  formulation  and  implementation  of  this 
algorithm. 

Building  Geometric  Models 

A  system  for  building  models  was  designed  and  implemented  by  [Takamura  84].  The 
system  was  designed  so  that  a  user  could  learn  to  use  it  in  one  hour  and  build  simple  mod¬ 
els  in  ten  minutes.  The  user  interface  included  voice  input  selection  from  menus,  combined 
with  keyboard  input  for  names.  Models  were  built  manually  using  stereo  pictures;  cor¬ 
responding  points  were  selected  with  a  track  ball.  Other  pointing  devices  could  be  used. 
Soon,  automated  stereo  will  be  sufficiently  robust  to  select  most  corresponding  points. 
Previously  we  built  a  geometric  editor  which  was  tact-based  and  one  which  used  pointing 
devices  to  construct  geometric  forms.  Also,  a  previous  system  built  models  automatically 
from  depth  data. 

The  system  simplifies  the  task  of  the  user  by  using  some  models  of  the  class  of  gen¬ 
eralized  cylinders  to  minimize  the  input  required.  It  uses  hierarchical  object  structure  to 
include  parts  which  can  be  identical  to  others  already  specified;  symmetry  relations  can  be 
specified  to  decrease  input.  It  also  generalizes  individual  models  to  generic  models  (object 
classes).  For  simple  objects,  only  four  points  are  required  to  specify  a  model.  For  rela¬ 
tively  complex  objects,  about  ten  points  are  necessary.  The  user  defines  cross  section  type 
and  the  few  points  to  specify  it,  e.g.,  three  points  to  specify  a  circle  or  rectangle.  For  a 
constant  sweeping  rule,  another  point  specifies  the  object.  Affixment  relations  of  one  part 
relative  to  another  must  be  specified.  The  relations:  Align,  Coplanar,  and  Flush  can  be 
specified.  Subpart  structure  can  also  be  specified.  The  system  provides  a  stereo  display  of 
the  geometric  model  which  enables  the  user  to  verify  that  the  model  is  reasonable  as  the 
user  constructs  it.  The  object  writes  out  a  textual  model  of  the  part.  It  also  determines 
generic  models  by  generalizing  constraints  which  determine  the  object  class.  As  the  user 
specifies  members  of  the  class,  the  system  generalizes  the  constraints  of  the  object  class. 
This  is  subject  to  overgeneralization  which  the  user  must  watch  for. 

Prediction 

Specularity 

Specularity  was  a  very  prominent  feature  of  the  industrial  parts  recognized  in  the  In¬ 
telligent  Thsk  Automation  project  sponsored  jointly  by  DARPA  and  Air  Force.  Specularity 
is  an  especially  important  problem  in  the  multi-sensor  integration  domain;  i.e.,  specularity 
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is  more  important  outside  the  visible  spectrum  than  in  it.  For  radar  and  acoustic  imag¬ 
ing  specularity  is  a  principal  property  of  images.  Prediction  and  analysis  should  include 
shading  effects.  A  generic  model  for  reflectivities  includes  specular  and  matte  components. 
Healey  Appendix  C  has  done  analytic  and  experimental  research  to  characterize  specular 
reflection.  The  results  show  that  useful  symbolic  predictions  can  be  made  for  model-based 
vision.  Further,  specularities  provide  local  estimates  of  the  projected  surface  curvature. 
Appendix  E  includes  details  of  this  work. 

Specularities  provide  intrinsic  information  about  surface  material  and  surface  geome¬ 
try.  They  are  usually  the  brightest  regions  in  an  image  and  often  have  very  high  contrast. 
Thus  they  are  easy  to  locate.  The  information  they  carry  is  very  meaningful.  If  specu¬ 
larities  are  not  properly  understood,  they  are  merely  nuisances,  like  shadows,  rather  than 
valuable  evidence.  For  a  generic,  model-based  vision  system,  the  issue  is  to  include  a 
symbolic  characterization  of  specularities  for  prediction  and  for  analysis,  characterizations 
which  will  hold  in  varied  situations. 

We  adopted  the  Torrance-Sparrow  specular  model.  It  assumes  that  the  surface  has  a 
distribution  of  surface  orientation,  depending  on  roughness.  A  part  of  the  micro-surface  will 
satisfy  the  specular  condition  for  angles  in  the  vicinity  of  the  specular  peak.  For  glancing 
incidence  there  will  be  surface  shadowing.  The  model  includes  a  Gaussian  distribution  of 
intensity  vs.  angle  about  the  specular  peak,  i.e.,  an  exponential  in  the  square  of  the  angle; 
the  rougher  the  surface,  the  wider  the  Gaussian.  The  specular  peak  is  such  that  the  ray 
to  the  source,  the  surface  normal,  and  the  ray  to  the  observer  are  co-plan ar,  and  that  the 
surface  normal  bisects  the  rays  to  the  source  and  the  observer. 

The  apparent  width  of  a  specularity  is  the  projected  width  of  the  Gaussian.  This 
allows  estimating  the  rate  of  change  of  surface  angle  with  projected  angle,  i.e.,  projected 
curvature.  Expressed  as  a  fraction  of  part  dimension,  the  ratio  is  an  intrinsic  property  of 
the  surface.  The  two  principal  curvatures  can  be  estimated.  Careful  measurements  with 
an  experimental  setup  on  an  optical  bench  confirm  the  calculated  behavior. 

Symbolic  Graphics  for  Geometric  Models 

Graphics  is  aimed  at  display  of  a  known,  single  view  or  sequence  of  known  views  of 
known,  individual  objects.  Graphics  is  useful  for  the  user  in  building  geometric  models, 
debugging  calculations  programs,  and  demonstrating  programs.  Graphics  computations 
can  be  useful  in  a  weak  class  of  model-based  vision  systems  for  individual  objects  from 
individual  views.  To  be  useful,  the  graphics  system  should  produce  symbolic  output  instead 
of  pixel  output,  e.g.,  edges,  apparent  edges,  vertices,  and  surfaces.  This  is  a  limited  form  of 
symbolic  graphics.  A  graphics  system  was  begun  at  this  level  of  symbolic  graphics  [Scott 
84]. 

Our  aim  is  a  vision  system  which  is  viewpoint-insensitive  for  classes  of  similar  objects. 
The  system  uses  geometric  models  to  make  predictions  which  are  generic  with  respect  to 
object  class  and  with  respect  to  viewpoint.  An  investigation  was  made  of  extending  the 
graphics  system  to  generic  prediction.  Extension  was  only  partially  successful.  This  system 
makes  use  of  Whitney’s  result  that  the  only  generic  singularities  of  projection  for  a  single, 
continuous  surface  are  folds  and  cusps.  Folds  are  apparent  edges,  i.e.,  limbs.  This  result 
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is  widely  used  in  classification  of  image  features.  Multiple  surfaces  introduce  obscurations 
at  Ts;  surface  discontinuities  introduce  edges  and  vertices. 

Limbs  and  cusps  are  found  by  an  iterative,  second-order  Newton-  Raphson  procedure 
which  finds  one  point  and  tangent  on  a  limb.  The  program  extrapolates  for  a  starting 
approximation  for  a  nearby  point  on  the  limb,  using  tangent  and  curvature  and  choosing 
the  step  length  to  make  the  expected  number  of  iterations  constant.  This  gives  a  fast 
solution  with  uniform  accuracy  of  the  limb.  Obscurations  are  found  by  placing  surfaces  in 
an  image  plane  quad  tree.  The  quad  trees  are  used  to  hold  pointers  to  symbolic  information 
about  limbs.  Hidden  surfaces  are  obtained  and  Ts  are  calculated.  Surfaces  are  ordered 
front  to  back. 
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Generic  Symbolic  Graphics 

The  symbolic  graphics  methods  described  above  are  effective  for  a  part  of  the  pre¬ 
diction  for  individual  objects  and  particular  viewpoints.  In  many  problems,  there  are  few 
objects  and  they  appear  in  a  few  stable  states.  It  is  reasonable  in  those  cases  to  store 
views  of  all  stable  states  of  all  objects.  Some  attention  has  been  paid  in  the  community 
to  storing  all  topologically  distinct  views  of  an  object.  [Koenderink  79]  describe  a  subdivi¬ 
sion  of  viewing  space  into  cells,  each  of  which  has  a  distinct  view  of  the  object.  Cells  are 
linked  in  a  graph  structure.  The  cells  are  determined  by  ruled  surfaces  which  divide  up 
the  viewing  space.  In  our  work  on  symbolic  graphics  we  have  investigated  this  approach. 

The  symbolic  structure  which  we  generate  has  infinitesimal  stability,  i.e.,  it  is  stable  under 
infinitesimal  transformations  of  object  or  viewpoint. 

However,  there  are  severe  barriers  to  practical  use  of  this  method  for  generic  predic¬ 
tion:  1)  it  is  dependent  on  individual  objects;  2)  there  are  many  distinct  views  of  even 
simple  objects,  i.e.,  a  polyhedron  of  n  faces  has  2"  distinct  views;  each  time  a  face  is  crossed 
there  is  a  distinct  view;  3)  the  graph  is  not  stable  under  large  deformations,  i.e.,  is  not 
quasi-invariant.  These  difficulties  have  proven  difficult  to  overcome.  No  effective  generic 
method  of  prediction  has  come  out  of  our  investigation  of  this  approach. 

Models  of  Sensors  and  Algorithms 

Without  an  explicit  model  of  sensors,  an  intelligent,  model-based  system,  e.g.,  ACRONYM, 
has  an  implicit  model  of  typical  TV  cameras  for  the  visible  spectrum.  The  system  is  lim¬ 
ited  to  that  source  of  sensor  data.  Its  implicit  model  of  the  data  is  not  very  good,  hence 
it  cannot  make  detailed  use  of  sensor  data.  Chelberg  is  building  a  subsystem  and  analytic 
models  of  sensor  and  perception  algorithms  to  enable  the  model-based  system  to  work 
with  a  variety  of  sensors,  to  integrate  multi-sensor  information,  to  plan  efficient  strategies 
for  perception,  and  to  make  accurate  predictions  of  observables  obtained  from  perception. 
Appendix  E  presents  a  status  report. 

We  intend  to  model  sensors  including:  cameras  for  the  visible  and  infrared;  triangu¬ 
lation  ranging  utilizing  stereo,  motion,  "structured  light”  ranging,  and  position- sensitive 
diode  measurements;  high  resolution  radar;  phase  measurement  ranging;  acoustic  ranging; 
and  force  and  tactile  sensing.  It  is  necessary  to  model  illumination,  also.  We  intend  to 
model  algorithms  including:  edge  detection;  edge  Unking;  curve  segmentation;  curve  group- 
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mg;  curve  Intersection  and  vertex  estimation;  region  segmentation;  and  texture  grouping. 
Together  with  geometric  models  of  objects  and  their  surfaces,  we  must  model  reflectivities 
of  surfaces  for  various  sensors. 

Sensors  give  drastically  different  response;  the  world  looks  very  different  in  radar 
or  infrared  compared  to  the  visible  spectrum.  A  major  aspect  of  the  system  is  generic 
prediction,  stable  over  a  range  of  viewpoints  and  stable  among  similar  objects  in  a  class. 
Making  analytic  quantification  of  sensors  and  algorithms  in  perception  is  a  step  toward 
including  multiple  sensors  in  generic  prediction  and  automatically  determining  the  limits 
of  generic  prediction  under  different  sensors. 

We  model  statistical  and  systematic  properties  of  sensors  and  algorithms.  A  camera 
is  characterized  by  angular  resolution  of  pixels,  MTF,  pixel  sampling  function,  intensify 
resolution,  noise  characteristics,  uniformity  of  response,  dynamic  range,  spectral  response 
and  color,  intensity  quantization,  bandwidth  and  sample  time,  lag,  blooming,  and  other 
properties.  Edge  operators  are  characterized  by  diameter,  angular  accuracy  vs.  contrast, 
transverse  position  accuracy  vs.  contrast,  false  positives  and  false  negatives  vs.  contrast, 
where  contrast  is  the  signal  to  noise  ratio,  computation  cost,  and  others  properties. 

The  system  has  objectives  and  sub-objectives  to  measure  object  properties  with  pre¬ 
scribed  reliability,  accuracy,  and  efficiency.  It  can  only  make  efficient  strategies  if  it  has  a 
way  of  characterizing  cost,  reliability,  accuracy,  and  ways  of  relating  measurements.  These 
are  important  properties  for  models. 
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TECHNICAL  REPORT  ON  TASK  3: 

RAPID  PRECISE  CONTROL  OP  NONRIGID  MANIPULATORS 

Overview 

The  underlying  objective  here  is  to  develop  the  sequence  of  technologies  that  will 
enable  future  generations  of  robots  to  move  much  more  quickly,  more  deftly,  than  today’s 
robots,  achieving  much  higher  levels  of  precision,  while  at  the  same  time  removing  the 
need  for  robots  to  be  the  heavy,  rigid,  power  hungry  machines  that  today’s  robots  are. 

Toward  this  objective,  we  are  pursuing  a  sequence  of  specific  projects,  each  with 
specific  capability  goals  to  be  demonstrated,  that  will  provide  key  elements  of  the  desired 
new  robot  technology  base.  The  AFOSR  Center  of  Excellence  level  of  funding  has  made  it 
possible  for  us  to  make  major  advances  toward  this  goal,  both  in  technological  capabilities 
achieved  and  in  the  development  of  experimental  facilities  and  expertise  needed  to  carry 
on  advanced  research  in  this  area. 

Typical  of  new  facilities  is  the  experimental  two-link  arm  with  flexible  tendons,  which 
was  completed  in  1984  with  AFOSR  and  DARPA  funding,  and  on  which  we  are  now  well 
underway  in  a  comprehensive  sequence  of  increasingly  difficult  experiments  that  will  lead 
to  demonstrations  of  more  sophisticated  robot  control  capabilities. 

The  flow  and  interaction  of  our  projects  is  indicated  in  Fig.  3-1  and  3-2.  The  different 
facilities,  indicated  by  the  boxes  in  Fig.  3-1,  are  depicted  more  graphically  in  Fig.  3-2.  * 

To  provide  a  helpful  overview,  Fig.  3-1  includes  early  manipulator  projects  that  pre¬ 
ceded  the  AFOSR  Center  of  Excellence  Funding  as  well  as  mutually  synergistic  projects 
that  are  funded  from  other  sources.  Each  box  in  Fig.  3-1  (e.g.,  “Flexible  Arm  with  Wrist-) 
indicates  a  system  that  has  been  (or  will  be)  developed.  The  blue  double  boxes  and  all 
of  the  Adaptive  Control  activity  are  AFOSR  funded  projects.  Each  new  capability  (e.g., 
“End  Point  Control”)  achieved  with  a  given  configuration  is  invariably  based  on  extending 
what  was  learned  first  with  an  earlier,  simpler  configuration;  and  each  of  these  new  capa¬ 
bilities  will  be  crucial  to  several  that  follow.  Thus,  for  example,  the  Center  of  Excellence 
funding  allowed  us  to  bring  the  flexible  manipulator  with  wrist  configuration  from  first 
conception  through  design  and  fabrication  and  assembly  to  a  working  system  on  which 
early  successful  experiments  with  end-point  control  have  already  been  accomplished.  But 
this  rapid  progress  was  based  firmly  on  the  earlier  step-by-step  development  of  the  single 
very-flexible  manipulator,  with  its  optical  tip-position  sensor  and  its  pioneering  end-point 
feedback  control.  (And  that  control,  in  turn,  was  able  to  draw  on  the  earlier  achievement 
of  non-colocated  control  of  the  very-low-?  disk  system.) 

Currently,  the  capabilities— of  end-point  control  using  two  actuators  in  concert  and 
of  obtaining  fine  precision — that  were  developed  first  for  the  flexible  arm  with  wrist,  now 
form  the  technical  base  for  the  major  series  of  developments  under  way  with  the  new  two- 
link  manipulator  facility:  experiments  with  control  in  two  dimensions,  with  first  optical, 
then  force  control;  experiments  with  two  arms  plus  double  wrist;  experiments  with  target 
tracking  and  rendezvous  leading  to  a  pair  of  two-link  manipulators  cooperating  to  perform 
higher-level  tasks.  Note  that  both  well-developed  force  control  (of  a  flexible  manipulator 

*  Fig.  3-t  it  not  eomprekentite.  It  doet  not  include  our  AFOSR  tpontored  fundamental  experiment!  in 
adaptive  control,  nor  our  NASA  tpontored  work  on  mobile  robott  uting  air  cutkion  vehicle*. 


tip)  and  task  programming  will  also  be  essential  supporting  capabilities  at  this  point;  and 
they  too  will  be  available  from  other,  concurrent  projects,  as  Fig.  3-1  shows. 

As  Fig.  3-1  indicates,  the  Two-Link  Manipulator  that  we  designed  and  built  early  in 
this  AFOSR  program  will  be  (with  its  derivatives  and  augmentation)  a  major  facility  for 
a  sequence  of  developements  and  demonstrations  that  will  make  more  directly  usable,  by 
robot  designers,  the  quite  fundamental  control  advances  we  have  been  able  to  achieve. 

A  most  important  fact  is  that  the  gratifyingly  rapid  progress  we  have  been  able  to 
achieve  in  each  of  the  projects  in  Fig.  3-1  is  due  in  great  measure  to  synergism  with 
the  other  concurrent  projects  in  whose  midst  it  exists.  The  major  AFOSR  Center  of 
Excellence  support,  together  with  the  other  funding  indicated  in  Fig.  3-1,  has  made  possible 
a  critical  mass  of  talented  people  and  new  equipment  and  activity,  without  which  many  of 
the  achievements  of  this  program  would  simply  not  have  occured  at  all,  let  alone  so  quickly. 
The  presence  concurrently  of  all  these  people  is  what  made  these  achievements  happen. 

Again,  the  basic  generic  thing  that  we  have  been  able  to  do  (and  be  the  first  to  do)  is 
control  very  light,  flexible  manipulators  in  swift,  purposeful  motions:  control  position  and 
force  at  their  tips  by  measuring  these  quantities  directly  and  feeding  them  back.  As -the 
sequence  of  projected  project  milestones  in  Fig.  3-1  unfolds,  we  aim  to  build  a  deliverable 
set  of  experimentally  demonstrated  fundamental  robot-control-system  design  technologies 
that  commercial  designers  can  apply  to  the  next  much  more  capable  generation  of  robotic 
systems. 


Achieving  the  Objectives  of  the  AFOSR-Supported  Robot  Manipulator  Re¬ 
search 

Guidance  for  the  research  supported  by  AFOSR  Contract  No.  F49620-82-C-0092  is 
provided  in  the  Contract  Statement  of  Work,  [AF  1]  Sections  B1  n,  o,  p,  q,  which  are 
repeated  here  for  convenience: 

n.  Extend  the  end-point  control  laws  developed  for  single  link  flexible  arm  operation  to 
two  link  operation  in  the  horizontal  plane  and  investigate  extension  to  the  vertical  plane 
dimensions  where  gravity  affects  the  system. 

o.  Investigate  the  capabilities  and  limitations  of  lumped-compliance  robot  arms.  Specif¬ 
ically,  determine  the  slew  speed,  end-point  settling  time  and  positioning  accuracy,  prox¬ 
imity  motion,  and  contact-force  performance  for  a  range  of:  flexibility,  payload  mass  and 
inertia,  actuator  power,  controller  bandwidth;  and  study  inherent  actuator  and  sensor 
non-linearities. 

p.  Extend  the  work  in  tasks  o  and  p  to  robot  arms  with  distributed  flexibility. 

q.  Investigate  the  performance  to  be  expected  of  the  complete  flexible  robot  arm  with 
end-effector  for  various  real-life  manufacturing,  assembly,  and  inspection  tasks. 

In  Fig.  3-1  the  specific  projects  that  address  these  work-statement  items  are  shown  in 
blue,  as  are  the  tasks  that  are  now  completed  and  reported  on  here,  namely: 

a.  A  two-link  lumped-compliance  experimental  robot  arm  has  been  built  and  tested;  and 
both  (conventional)  joint-controlled  tasks  and  (new)  endpoint-controlled  tasks  have 
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been  carried  out  to  fulfill  work  statement  items  n  and  o.  Results  of  this  research  are 
described  in  Section  a.  below. 

(See  particularly  the  Summary  at  the  end  of  Section  3a.) 

b.  Another  experimental  arm  consisting  of  a  long,  very  flexible  inner  link  and  a  short, 
quick  outer  link  (wrist)  has  been  built,  (see  Fig.  3-4)  and  definitive  tests  have  been 
carried  out  to  fulfill  items  p  and  q  of  the  work  statement.  In  particular,  the  sys¬ 
tem  has  been  operated  in  a  pick- and- place  mode  where  it  has  demonstrated  that  the 
basic  control  technology  for  precise,  rapid  end-point  optical  control  of  tasks  within 
a  workstation  is  now  in  hand:  The  system  demonstrated  precise,  flexible  pick-and- 
place  tasks  independent  of  motions  of  the  carrier  arm,  and  ten  times  faster  than  the 
dynamic  limits  of  even  this  lightweight  carrier  arm.  In  another  demonstration,  the 
carrier  arm  was  slewed  rapidly  from  one  workstation  to  another,  and  the  wrist  began 
and  completed  pickup  or  place  tasks  at  the  new  station  well  before  the  carrier  could 
even  settle  down.  These  new  results  are  reported  on  in  detail  in  Section  3b.  below. 

c.  In  addition  to  the  above  projects,  which  fulfill  the  original  statement-of-work  items 
(with  a  body  of  very  interesting  and  useful  results),  we  have  also  proceeded  to  carry  out 
research  in  two  other  important  areas.  First,  we  have  completed  two  major  studies 
on  strategy  for  task  command  and  control  of  two-link  manipulators,  which  will  be 
valuable  in  future  phases  of  our  experimental  work.  These  are  described  briefly  in 
Section  3c.  below,  and  are  reported  on  fully  in  separate  reports  as  well  as  in  two  Ph.D 
theses. 

d.  Finally,  we  have  proceeded  to  attack  rather  vigorously  the  generic  problem  of  adap¬ 
tive  control.  This  has  been  a  fashionable  topic  for  mathematical  studies  for  some 
decades;  but  the  near  non-existence  of  experimental  results  has  made  the  promise  an 
unfilfilled  one  to  date.  We  have  now  begun,  with  AFOSR  encouragement,  an  exper¬ 
imental  program  aimed  at  robot  applications:  for  the  payoff  could  be  great  indeed 
for  future,  high-performance  assembly-type  robots.  We  have  achieved  some  promising 
preliminary  experimental  results  in  three  different  thrusts.  This  work  is  also  reported 
below  in  Section  3d. 


(a)  Vtry  Flodbk  One- Link  Manipulator 
(Rapid  pick  and  plaea.) 

(b)  Vary  Flexible  Manipulator  with  Forea  Control 
(Slaw  and  Tonek  moving  targat.) 


(e)  Flaodbla  Manipulator  witk  Fast  Wrist 
(Praeiaa  anatck  and  plaea.) 


(d)  Flaodbla  Maaipnlator  witk  Fast  Wrist 
(Slaw  and  Pradaion  tonek.) 


(a)  Two- Link  Arm  witk  Elastic  Tendons 

(2D  pick  and  plaea)  slaw  and  position  tonek.) 


(f)  Cooperating  Two-Link 
(Long-part  kandling.) 


(g)  Taro-Link  Arm  witk  Donbla  Wrist 
(Vary  fast  pracisa  2D  tasks.) 


(k)  TwoFlaodbla-Link  Arm 
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TASK  3a. 

TWO  LINK  MANIPULATOR  WITH  FLEXIBLE  TENDONS 


Introduction 

The  successful  achievement  of  accurate,  high-bandwidth  end-point  control  of  the  Stan¬ 
ford  one-link  flexible  manipulator  provided  the  groundwork  for  extending  the  technology 
to  the  general  multi-link  flexible  manipulator  case.  Toward  this  goal,  we  constructed  a  two- 
link  manipulator  in  the  horizontal  plane  (so-called  SCARA  configuration)  with  a  vertical 
drive  at  the  working  end  (see  Fig.  3a.- 1). 

The  end-point  control  of  a  two-link  arm  represents  a  significant  increase  in  com¬ 
plexity  over  the  one-link  flexible  arm  research  pioneered  in  our  lab.  The  complexities 
are  introduced  in  three  main  areas.  First,  the  two-link  arm  dynamics  and  kinematics  are 
highly  non-linear.  Second,  the  two-link  arm  system  is  inherently  multi-input,  multi-output 
(MIMO)  since  the  dynamics  are  highly  coupled  and  in  general  cannot  be  decoupled  into 
smaller  single-input,  multi-output  (SIMO)  systems.  Third,  the  design  and  construction  of 
an  end-point  sensor  system  that  gives  a  high  signal-to-noise  ratio  and  high  repeatability 
over  a  planar  sensing  area  was  required. 

There  is  one  area  where  the  two-link  arm  has  been  intentionally  made  simpler  than  the 
one-link  arm:  the  system  flexibility  has  been  discretely  lumped  in  the  form  of  springs  in  the 
drive  train  instead  of  continuously  distributed  in  the  structure.  Thus,  the  problem  has  been 
initially  simplified  in  one  respect  so  that  we  can  more  easily  handle  the  new  complexities 
of  two  links.  Later  versions  of  the  two-link  arm  will  include  continuously  flexible  structural 
elements.  In  fact,  the  rigid  wrist  attached  to  the  one-link  flexible  manipulator  represents 
initial  studies  of  the  case  of  a  flexible  upper  link  and  a  rigid  forearm  link. 

Non-Linear  Dynamics  and  Kinematics 

The  two-link  arm  dynamics  are  non-linear  in  three  different  ways.  First,  the  inertia 
of  the  complete  arm  about  the  shoulder  joint  is  a  cosine  function  of  the  elbow  joint  angle. 
Thus,  pulling  the  arm  in  will  decrease  the  overall  arm  inertia,  and  the  system’s  vibra¬ 
tion  frequencies  will  change.  Second,  there  are  centripetal  accelerations  present  which  are 
functions  of  the  square  of  the  link  angular  velocities.  For  the  high  speeds  at  which  our 
system  operates,  these  non-linear  acceleration  terms  are  roughly  the  same  order  of  magni¬ 
tude  as  the  linear  acceleration  terms  and  cannot  be  ignored.  The  third  major  non-linearity 
is  the  large  variation  in  inertia  due  to  large  changes  in  payload  mass.  Other  practical 
non-linearities  that  have  to  be  compensated  or  eliminated  through  careful  design  include 
motor  and  joint  stiction,  friction,  hysteresis,  backlash,  and  gravity  effects. 

These  non-linear  dynamics  and  kinematics  have  always  been  present  on  robotic  sys¬ 
tems  built  in  the  past,  but  could  be  accommodated  with  little  adverse  impact  on  perfor¬ 
mance  by  operating  the  system  at  very  low  bandwidths. 


The  unique  features  of  our  manipulator,  which  require  meticulous  consideration  of  these 
non-linearities,  are  the  high  operating  speeds,  the  presence  of  variable  flexible  modes,  the 
large  payload-to-  arm-  inertia  ratio  about  the  shoulder  joint  (about  1:1  for  our  arm  compared 
to  1:10  for  most  arms),  and  especially  the  use  of  end-point  sensing. 

Multi- Input-Multi- Output  (MIMO)  Character 

The  MIMO  aspect  of  the  two-link  arm  (along  with  the  quick-wrist  system,  Task  3b.) 
represents  a  major  step  for  our  robotics  lab.  Most  of  our  previous  experiments  with  the 
one-link  manipulator  position  and  touch  control  have  been  SIMO  systems  which  can  be 
treated  with  classical  control  analysis  and  design  techniques  (such  as  Root  Locus,  Bode  and 
Nyquist).  The  two-link  arm  is  inherently  a  MIMO  system  and  is  difficult  to  treat  with  these 
techniques.  State-space  methodologies  such  as  Linear  Quadratic  Loss  and  Sandy  Gradient 
Search  techniques  have  been  successfully  used  in  prior  research  on  MIMO  systems. 

New  End-Point  Sensor  Technology 

To  achieve  useful  end-point  control  for  the  two-link  and  future  manipulators,  the  end¬ 
point  sensor  must  be  able  to  sense  position  in  a  plane  (in  three  dimensions  for  the  general 
case),  have  a  bandwidth  much  faster  than  the  desired  closed  loop  bandwidth,  have  a  high 
signal-to-noise  ratio,  have  the  accuracy  and  repeatability  required  for  the  desired  task, 
and  the  capability  to  track  moving  targets  as  welL  As  a  surrogate  for  anticipated  vision 
systems,  which  have  all  these  characteristics,  the  one-dimensional  end-point  sensor  used 
for  the  single-link-manipulator  experiments  was  entirely  redesigned  for  this  task. 

This  final  report  contains  a  complete  description  of  the  experimental  apparatus  mod¬ 
eling  and  identification  of  the  two-link  manipulator,  a  computer  simulation  of  the  manipu¬ 
lator,  control  system  design,  analysis,  and  experimental  results  for  two  different  controllers 
and  a  summary. 

Experimental  Apparatus 

The  experimental  apparatus  (Fig.  3a.-l)  consists  of  four  major  components:  (1)  the 
manipulator  structure  and  drive  system;  (2)  the  sensors  and  associated  electronics;  (3) 
the  control  computer  and  associated  interface  electronics;  and  (4)  the  software  for  control 
design,  analysis,  and  real-time  control  implementation. 

Manipulator  Structure  and  Drive  System 

Fig.  3a.-  la  is  a  photograph  of  the  two-link  rigid  arm  with  flexible  tendon  drives.  The 
basic  structure  consists  of  a  support  base  and  two  rigid  links  lying  in  a  plane  perpendicular 
to  gravity  and  connected  by  revolute  joints.  The  drive  motors  are  attached  to  the  base 
and  transmit  torque  to  the  links  via  a  lightly  geared  tendon  drive  train.  The  tendons  have 
springs  connected  in-line  as  the  source  of  exaggerated  flexibility.  At  the  end  of  the  arm  is  a 
decoupled  vertical  axis  and  simple  gripper  that  gives  the  arm  complete  three  dimensional 
positioning  capability. 


The  support  base  was  constructed  with  about  1000  kg  of  reinforced  concrete  and  a 
3/4  in.  thick  aluminum  mounting  plate  for  the  motors,  drive  train,  and  first  joint.  The 
concept  behind  such  a  massive  base  was  to  provide  an  essentially  immovable  and  rigid 
support  structure  which  does  not  interact  dynamically  with  the  flexible  manipulator  and 
adversely  affect  the  results.  The  aluminum  mounting  plate  also  has  provisions  for  balancing 
the  manipulator  or  tilting  it  up  to  15  degrees  to  allow  up  to  a  25%  component  of  gravity 
to  affect  the  system. 

As  shown  in  the  schematic  of  the  manipulator  in  Fig.  3a.-  lb,  the  motor  in  the  right 
cavity  of  the  base  drives  the  shoulder  joint  and  upper  arm  link  through  four  springs,  while 
the  motor  in  the  left  cavity  of  the  base  drives  the  elbow  joint  and  forearm  link  viar  an 
idler  pulley  centered  about  the  shoulder  joint  and  then  through  two  springs.  Each  spring 
has  a  nominal  spring  constant  of  40  lb/in  (7000  N/m).  The  arm  was  designed  to  have 
minimum  weight  and  inertia  about  the  joints  and  yet  be  very  stiff  structurally  by  using 
aluminum  tube  and  shell  construction.  The  maximum  vertical  sag  when  fully  loaded  was 
designed  to  be  less  than  1  mm,  and  any  structural  vibration  frequencies  are  well  beyond 
those  created  with  the  springs  in  the  tendon  drives.  Each  link  is  about  one-half  meter  long. 
The  shoulder  joint  has  a  range  of  ±90  degrees  and  the  elbow  joint  has  a  range  of  ±120 
degrees.  This  gives  the  manipulator  a  180  degree  arc-shaped  operational  envelope  with  a 
minimum  reach  of  0.5  meter  and  a  maximum  reach  of  1.0  meter  from  the  shoulder  joint. 
The  vertical  axis  gives  about  15  cm  of  vertical  operational  space.  The  arm  was  designed 
to  have  a  payload-to-arm-inertia  ratio  about  the  shoulder  of  about  one.  The  large  payload 
capability,  combined  with  the  ability  to  change  the  springs  in  the  tendon  drives  and  the 
inertia  at  the  motor  shaft,  gives  the  system  a  very  wide  range  of  plant  dynamics  for  study. 

The  drive  motors  are  so-called  “printed  circuit*  electric  DC  motors  that  have  no 
ferrous  material  in  the  armature.  Thus  the  motors  have  no  cogging  torque  and  the  ripple 
torque  is  minimized.  The  dominant  non-linearity  in  the  motors  is  brush  friction  and 
stiction,  and  these  have  been  reduced  to  acceptable  levels  by  feedforward  and  dither.  The 
motors  can  provide  up  to  1580  oz-in.  (11.2  N-m)  of  torque,  while  the  motor  torque  non- 
linearities  can  be  held  to  less  than  5  oz-in.  (0.04  N-m).  The  motors  and  gearing  were 
sized  such  that  the  unloaded  arm  can  theoretically  move  between  any  two  points  in  its 
operational  envelope  within  one  second.  For  the  one  meter  arm  this  gives  accelerations 
on  the  order  of  one  gravity  (10  m/sec2)  at  the  tip.  The  shoulder  drive  train  has  a  6.06  to 
1  gear  reduction,  and  the  elbow  drive  train  has  a  2.91  to  1  gear  reduction.  The  gearing 
was  sized  to  provide  almost  direct  drive  capability  to  minimize  gearing  problems  such 
as  backlash  and  large  friction,  rather  than  to  provide  the  optimum  impedance  match  for 
power  transmission. 

The  vertical-axis  drive  system  was  designed  to  move  up  to  a  1  kg  payload  through  the 
full  15  cm  range  of  motion  in  about  two  seconds.  The  vertical  axis  is  driven  with  its  own 
decoupled  actuation  system  consisting  of  a  small  DC  torque  motor  with  optical  encoder 
position  sensor  which  drives  a  lead  screw  which  in  turn  moves  the  gripper  vertically.  A 
pneumatic  gripper  at  the  tip  of  the  vertical  axis  provides  grip  actuation  on  the  order  of 
50  msec  and  is  designed  to  pick-up  one  type  of  payload,  a  disk  (of  mass  <  1  kg)  with  a 
cylindrical  grip  hole  machined  in  the  center. 

The  two-link  arm  hardware  has  undergone  several  upgrades  and  "tuning”  to  improve 
performance.  The  elbow  joint  had  to  be  stiffened,  the  other  joints  realigned  and  all  the 
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bearings  replaced  with  higher  grade  bearings  or  self- aligning  bearings  to  reduce  stiction  in 
the  system.  The  final  major  change  will  be  to  replace  the  plastic/steel  tendons  with  all 
steel  tendons  to  further  improve  drive  train  linearity. 

Sensors  and  Associated  Electronics 

The  primary  sensor  for  the  two-link  arm  is  the  optical  end-point  sensor 
(see  Fig.  3a.- 1).  The  basic  construction  of  the  sensor  is  a  single  large  silicon  wafer  photode¬ 
tector  with  associated  optics.  The  center  of  brightness  observed  by  the  photodetector  is 
output  as  a  ratio  of  voltages  across  two  perpendicular  axes  on  the  wafer.  The  new  version 
has  a  40  dB  improvement  in  signal-to-noise  ratio  over  the  original  one-link  manipulator 
end-point  sensor.  The  sensor  is  tuned  to  observe  rapidly  flashing  infrared  LED's  mounted 
on  the  tip  of  the  arm  without  the  need  of  a  light  isolation  hood.  The  bandwidth  of  the 
sensor  for  tracking  one  point  is  about  500  Hz  and  provides  a  resolution  of  1  part  in  1000 
over  the  range  of  the  sensor  (i.e.,  1  mm  for  a  1  meter  range). 

The  system  is  also  well  instrumented  with  secondary  sensors.  Each  motor  has  a 
tachometer  and  an  1800  line  optical  encoder.  The  shoulder  joint  has  a  4096  line  optical 
encoder,  and  the  elbow  joint  has  a  2540  line  encoder.  End-point  position  can  be  inferred 
to  an  accuracy  of  about  1  mm  using  these  encoders  (assuming  rigid  links  and  current 
calibration  data),  and  rate  information  can  be  derived  from  the  optical  encoders  using  a 
special  electronics  board  developed  in  our  lab. 

An  electronics  rack  has  been  built  to  house  the  sensor  electronics,  motor  power  supplies 
and  amplifiers,  and  computer  input /ouput  connections.  The  sensor  electronics  housed 
includes  the  end-point  sensor  electronics,  five  optical  encoder  position  and  rate  boards 
(two  for  the  motors,  two  for  the  joints  and  one  for  the  vertical  axis),  and  motor  tachometer 
outputs.  The  motor  controller  includes  three  separate  analog  inputs  to  each  motor,  current 
limiters,  and  motor  disabling  electronics  for  safe  and  quick  shut  down  of  the  system  in 
case  of  computer  failure,  intermittent  power  failure,  or  imminent  harm  to  equipment  or 
people.  The  computer  I/O  connections  include  twelve  12-bit  digital  to  analog  converters, 
32  differential  12- bit  analog  to  digital  converters,  and  a  digital  I/O  cable  for  the  encoder 
electronics. 


Control  Computer 

The  control  computer  is  a  DEC  PDP  11/24  mini-computer  with  a  hardwired  floating 
point  board.  In  addition  to  the  I/O  electronics  listed  above,  the  computer  system  has  a 
real-time  clock,  IEEE  488  bus,  two  RL02  removable  hard  disks  and  asynchronous  com¬ 
munication  ports  for  connections  to  printers  and  direct  lines  to  a  VAX  11/780  mainframe 
computer  cluster.  The  VAX  computers  are  used  for  control  design,  analysis  and  simula¬ 
tion,  while  the  PDP  11/24  is  used  to  implement  the  controllers  in  real-time.  The  PDP 
11/24  is  running  under  RTll  version  5.2  operating  system,  and  the  control  programs  are 
written  in  FORTRAN  and  PDP  assembly  language.  The  real-time  control  programs  are 
run  at  50  Hz  to  200  Hz  sample  rates  depending  upon  the  complexity  of  the  controller. 


Software 

Most  of  the  control  analysis,  design,  and  simulation  software  used  on  this  project  was 
either  commercially  available  or  previously  written  here  at  Stanford.  These  include  the 
Stanford  developed  OPTSYS,  DISC,  and  SANDY,  which  are  state-space  linear  quadratic 
Gaussian  design  tools  for  MIMO  systems.  OPTSYS  designs  estimators  and  regulators  for 
continuous  analog  control.  DISC  designs  estimators  and  regulators  using  discrete,  sampled 
data  controllers  such  as  digital  computers.  SANDY  designs  low  order,  robust  controllers 
for  continuous  analog  control.  Analysis  and  simulation  tools  including  the  commercially 
available  MatrixX  and  Control-C  have  proven  very  useful  in  our  research.  A  graphical 
simulation  tool  has  also  been  developed  here  during  the  course  of  our  research. 

Most  of  the  real-time  control  and  peripheral  software  was  developed  in  our  lab  using 
FORTRAN  and  PDP  assembly  language.  The  software  developed  for  the  one-link  flexi¬ 
ble  arm  was  modified  and  enhanced  for  use  on  the  two-link  arm.  The  software  includes 
assembly  language  drivers  for  the  clock,  analog-to-digital  converters,  digital-to-analog  con¬ 
verters,  end-point  sensor,  and  optical  encoders.  Assembly  routines  were  also  written  to 
speed  up  matrix  and  other  floating  point  calculations  used  in  the  control  loop.  FORTRAN 
programs  include,  of  course,  the  control  programs,  testing  and  calibration  programs  for 
all  of  the  hardware,  and  a  library  of  useful  subroutines  that  perform  the  kinematic  arm 
solution,  inverse  dynamics  solution,  data  storage  and  retrieval,  data  transmission  to  and 
from  the  VAX,  system  identification  software,  and  I/O  handlers  for  the  control  programs. 

Modelling  and  Identification 

A  good  model  of  the  two-link  arm  and  the  identification  of  the  parameters  of  the 
model  are  required  for  control  system  design  and  implementation.  As  a  first  step  in  the 
modelling  and  identification  of  the  two-link  arm,  the  system  with  the  elbow  locked  was 
modelled  and  identified.  Since  the  arm  with  the  elbow  locked  is  a  single-input  linear  system, 
this  also  helped  to  isolate  and  characterise  actuator  and  sensor  non-linearities  which  were 
masked  by  the  non-linearities  and  multi-input-multi-output  (MIMO)  character  of  the  full 
system.  Substantial  non-linear  motor  friction  and  tendon  plasticity  were  identified  and 
compensated.  Next,  a  complete  non-linear  model  of  the  plant  was  developed  and  then  its 
parameters  were  identified. 

Locked-Elbow  Model  and  Identification 

A  model  of  the  two-link  arm  with  the  elbow  locked  is  shown  in  Fig.  3a.-2.  Since  the 
intermediate  gearing  stage  is  kinematically  coupled  with  the  motor,  only  four  states  are 
required  to  describe  the  system: 
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The  equations  of  motion  for  this  system  are  given  by: 
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where  the  intermediate  symbols  are: 


ks  =  4 KsuTut  torsional  spring  constant. 
ns  =  riirii,  total  gear  ratio. 

To 

n,  =  — ,  motor  to  intermediate  stage  gear  ratio. 

n 

n%  —  ~j~)  intermediate  stage  to  joint  gear  ratio. 

*7 

Iu  —  if  +  if  +  muc +  mpt %,  arm  inertia  about  joint. 
6S  =  2 dsurfn  torsional  damping. 


and  the  physical  parameters  are: 

KSv  •  Linear  spring  constant  between  shoulder  motor  and  upper  arm. 

rs,  rt,  rj,  rUt :  Radii  of  shoulder  motor  pulley,  intermediate  stage  input,  intermediate 
stage  output,  and  upper  arm  pulley,  respectively. 

If,  If  If ,  If, :  Planar  inertias  of  the  shoulder  motor,  intermediate  stage,  upper  arm, 
and  payload,  respectively,  as  calculated  about  each  body’s  center  of  mass. 

ds,du,dsu  •  Viscous  friction  about  the  shoulder  motor,  upper  arm  joint  and  between 
the  motor  and  joint,  respectively. 


mu,  mP,  •  Masses  of  upper  arm  and  payload,  respectively. 

cu  :  Distance  from  upper  arm  joint  to  upper  arm  center  of  mass. 

tu  :  Distance  from  upper  arm  joint  to  payload  center  of  mass. 

The  system  parameters  were  identified  by  running  a  sine  sweep  test  with  the  input 
being  the  voltage  command  to  the  shoulder  motor  which  generates  torque  T s  and  the 
output  being  the  voltage  from  the  tachometer  which  measures  rate  U5.  The  resulting 
Bode  magnitude  and  phase  plot  from  the  test  is  shown  in  Fig.  3a.-3  as  dashed  lines.  FFom 
the  state-space  description  of  the  system  (Eq.  1),  the  transfer  function  from  tachometer 
output  to  motor  input  is  given  by: 

us  s2  +  2  {,Ut3  +  u* 

Ts/Is  ~  (3  +  d)(s>  +  2sPups  +  ul)  W 

where  the  frequency  domain  parameters  are: 
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and  the  “reduced"  inertia  and  damping  are: 
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A  Bode  magnitude  and  phase  plot  of  the  transfer  function  model  is  shown  in 
Fig.  3a.-3  as  solid  lines.  The  numerical  values  of  the  physical  parameters  identified  are 
listed  in  Table  3a.- 1.  Note  that  the  low  frequency  portion  of  the  theoretical  Bode  plot 
does  not  exactly  match  the  experimental  Bode  plot.  This  discrepancy  is  due  to  non-linear 
Coulomb  friction  present  in  the  motors. 
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Note:  The  planar  inertias,  masses,  and  link  center  of  mass  location  were 
not  explicitly  identified.  The  damping  parameters  are  somewhat 
artificial  since  we  are  trying  to  fit  linear  viscous  damping  to  non¬ 
linear  Coulomb  friction  and  stiction. 

Table  3a. *1 

One-Link  Arm  Identified  Parameters 
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Motor  Friction  and  Drive  Train  Non-Linearities 

In  the  course  of  identifying  the  locked-elbow  system,  the  system  damping  was  noted 
to  be  much  higher  than  predicted  by  motor  specifications  and  viscous  bearing  damping.  A 
simple  pendulum  test  of  the  motor  (the  motor  acting  as  the  pivot  for  a  hanging  rigid 
pendulum)  showed  that  the  resulting  sine  wave  decayed  linearly  with  time  instead  of 
exponentially  as  predicted  by  assuming  viscous  damping.  The  linear  decay  in  amplitude 
indicates  that  Coulomb  friction  predominates.  Torque  break-away  experiments  showed 
that  a  small  amount  of  stiction  torque  was  also  present.  The  pendulum  test  results  and 
graph  of  the  resulting  friction  model  are  shown  in  Fig.  3a.-4. 

The  Coulomb  friction  was  measured  to  be  approximately  11  oz-in.  and  the  stiction 
about  12  oz-in.  The  Coulomb  friction  has  been  successfully  compensated  by  feeding  for¬ 
ward  the  measured  Coulomb  friction  level  as  a  function  of  direction  of  rotation  of  the 
motor  shaft.  This  compensation  effectively  reduces  the  Coulomb  friction  levels  to  2  -  4 
oz-in. 

Significant  bias  torques  (on  the  order  of  the  Coulomb  friction  torque,  i.e.,  10  •  20  oz-in. 
as  measured  at  the  motors)  are  present  in  the  drive  train  due  to  plastic  deformations  of  the 
plastic  cable  drive  as  they  follow  the  small  gear  radii  and  by  other  wires  and  pneumatic 
tubes  that  cross  the  robot  joints.  These  effects  are  currently  compensated  by  integral 
control  action.  However,  a  new  all-steel  cable  drive  has  just  been  built  and  will  be  installed 
soon.  This  change  along  with  redirection  of  the  wiring  should  reduce  these  bias  torques 
significantly. 


Two-Link  Arm  Model  and  Identification 

A  model  of  the  two-link  arm  is  shown  in  Fig.  3a.-5.  Since  the  two  intermediate  gearing 
stages  are  kinematically  coupled  with  the  motors,  only  eight  states  are  required  to  describe 
the  system: 
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The  non-linear  equations  of  motion  for  this  system  are  shown  in  Fig.  3a.-6,  where  the 
intermediate  symbols  are: 
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Motor  Position  vs.  Time 


Stiction 
"12  oz-in. 


Viscous  Friction 
0.05  oz-in./rad/s 

-Jl _ _ 


Coulomb  Friction 
"  1 1  oz-in. 


Friction  Test  of  Motor 

a)  Experimental  Pendulum  Decay 

b)  Resulting  Friction  Model 

Fig.  3a.*4 
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ks  =  4 Ksuffn  shoulder  torsional  spring  constant 

ke  =  2 Kep^fi  elbow  torsional  spring  constant 
ns  =  nifij,  total  shoulder  gear  ratio 
ns  —  ns,  elbow  gear  ratio 


r»i  =  rs/r/,  shoulder  motor  to  intermediate  stage  gear  ratio 

n2  =  rir/r'u  intermediate  stage  to  shoulder  joint  gear  ratio 

n3  =  tb/tf,  elbow  gear  ratio 

J5  =  /f  +  n\lf,  effective  shoulder  motor  inertia 

la  =  If  +  mv&u  +  mpty  +  mrta,  effective  shoulder  joint  inertia 

Ie  —  If  +  nflf,  effective  elbow  motor  inertia 

If  =  if  + If  +  mpCp  +  m,£r,  effective  elbow  joint  inertia 
Ipu  =  rnpCptu  +  mptolpt  inertia  coupling  term 

6S  —  2dSv^ut  torsional  shoulder  damping 
SE  =  2 dEFTpi  torsional  elbow  damping 

A  =  IjjIf  -  Jpu^Ftrt  a  mass  matrix  determinant 
cfu  =  co a(qp  —  qu) ,  cosine  of  relative  elbow  angle 
sfv  =  sin (qp  —  qu),  sine  of  relative  elbow 


(6) 


and  the  physical  parameters  are: 


KSu,  Kef  Linear  spring  constant  between  shoulder  motor  drive  and  upper  arm;  and 
elbow  motor  drive  and  forearm,  respectively. 


rs,  n,  rj,  ru,  rE,  rF  :  Radii  of  shoulder  motor  pulley,  intermediate  stage  input,  interme¬ 
diate  stage  output,  upper  arm  pulley,  elbow  motor  pulley,  and  forearm  pulley,  respectively. 


If,  /j,  I?,  If,  If ,  If,  If  :  Planar  inertias  of  the  shoulder  motor,  intermediate  stage, 
upper  arm,  and  payload,  elbow  motor,  forearm,  and  idler  pulley,  respectively,  as  calculated 
about  each  body’s  center  of  mass. 
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ds,du,dsu,  dE,  dp,  dEF  :  Viscous  friction  about  the  shoulder  motor,  upper  arm  joint, 
between  the  shoulder  motor  and  joint,  the  elbow  motor,  the  forearm  joint,  and  between 
the  elbow  motor  and  joint,  respectively. 

my,  mp,  mr  :  Mass  of  upper  arm,  payload,  and  forearm  respectively. 

Co  :  Distance  from  upper  arm  joint  to  upper  arm  center  mass. 

to  :  Distance  from  upper  arm  joint  to  elbow  joint. 

cp  :  Distance  from  forearm  joint  to  forearm  center  mass. 


tp  :  Distance  from  forearm  joint  to  payload  center  mass. 


For  purposes  of  identification,  a  linearised  set  of  equations  for  a  particular  configu¬ 
ration  can  be  used.  The  equations  of  motion  conveniently  decouple  for  the  case  of  the 
forearm  link  90  degrees  relative  to  the  upper  arm  and  small  angular  velocities.  The  two 
resulting  decoupled  sets  of  equations  of  motion  are  given  by  state  equations  very  aimilar  to 
those  obtained  for  the  locked  elbow  case  in  Eq.  1.  Thus,  the  complete  system  parameters 
can  be  identified  by  two  tests. 

The  system  parameters  were  identified  by  running  a  sine  sweep  test  of  each  part  of  the 
decoupled  system.  In  each  case  the  input  was  the  voltage  command  to  the  motor  which 
generates  torque  T5  (or  TE)  and  the  output  was  the  voltage  from  the  tachometer  which 
measures  rate  u5  (or  uE).  From  the  state-space  description  of  the  decoupled  systems  ,  the 
transfer  function  from  shoulder  tachometer  to  the  shoulder  motor  is  given  by  the  same 
equation  as  Eq.  3  and  the  transfer  function  from  the  elbow  tachometer  to  the  elbow  motor 
is  given  by  a  similar  equation: 


uE  _  a 2  +  2fJu,a  + 1»/* 

Tb/ Ib  (a  +  d)  (a2  +  2{,ur a  +  u*) 


where  the  frequency  domain  parameters  are  given  by  equations  similar  to  Eq.  4  including 
the  "reduced*  inertia  and  damping: 


Numerical  values  of  the  measured  frequency  domain  parameters,  the  intermediate 
parameters  and  the  physical  parameters  for  the  two-link  manipulator  are  listed  in  Table 
3a.-2.  Note  that  the  planar  inertias,  masses  and  link  centers  of  mass  locations  were  not 
explicitly  identified.  Only  "lumped”  parameters  such  as  IF  could  be  identified.  The  damp¬ 
ing  parameters  are  somewhat  artificial  since  we  are  trying  to  fit  linear  viscous  damping  to 
non-linear  Coulomb  friction  and  stiction. 

The  experimentally  determined  transfer  function  and  the  model  transfer  function  and 
the  model  transfer  function  match  very  closely  except  in  the  very  low  frequency  range. 
The  mis-match  is  due  to  motor  stiction  and  Coulomb  friction  which  dominate  the  motion 
at  the  low  torque  levels  commanded  by  the  sine-swep  equipment  at  the  lower  frequencies. 
The  magnitude  of  the  Coulomb  friction  in  each  motor  was  identified  by  simple  pendulum 
tests  to  be  about  11  os-in.  and  is  successfully  compensated  to  a  residual  of  about  3  os-in 
for  the  controllers  described  in  this  paper. 

Simulation  of  Two-Link  Arm 

Simulations  of  the  linearized  and  the  full  non-linear  equations  of  motion  of  the  two-link 
arm,  with  graphical  output  showing  the  motion  of  the  arm,  were  developed.  The  physical 
parameters  of  the  actual  system  were  used  in  the  simulated  theoretical  model  to  verify  the 
accuracy  of  the  model.  By  comparing  the  model  output  and  the  actual  output  of  the  arm, 
the  model  was  revised  to  better  match  the  experimental  apparatus.  Simulations  of  the 
revised  theoretical  model  have  allowed  us  to  study  and  to  verify  physical  characteristics 
of  the  system,  to  verify  (in  the  future)  closed  loop  control  designs,  to  avoid  dangerous 
situations,  and  to  extrapolate  performance  to  systems  with  different  physical  parameters 
that  cannot  be  investigated  with  the  experimental  apparatus  in  our  lab. 

The  simulations  of  the  equations  of  motion  were  written  in  Pascal,  with  the  graphics 
output  program  written  in  C,  on  a  Macintosh  computer.  The  non-linear  equations  of 


Frequency  Domain 
Parameters 

Intermediate 

Parameters 

Physical 

Parameters 

—  Shoulder  — 

Kg  =  117  2  N-m/r 

Ksu  =  7000  N/m 

cuz  *  171  Hz 

Kc  =  58.6  N-m/r 

Kef  »  7000  N/m 

Cz  -  0.03 

ns  *  0.165 

rs  =  0.026  m 

c op  -  9.10  Hz 

r\  -  0.344 

rj  -  0.065  m 

CP  *  0  10 

n1  *  0.406 

r‘i  *  0.026  m 

d  *  0  10  Hz 

n2  =  0  406 

ry  *  0.065  m 

n3  -  0.344 

rE  *  0.022  m 

—  Elbow  — 

Is  -  0  0010  kg-m2 

rF  -  0  065  m 

gjz  =  2.61  Hz 

Iy  *  1.02  kg-m2 

dg  »  0.007  N-m/r/s 

Cz  3  0  03 

IE  »  0  0013  kg-m2 

dy  *  0  402  N-m/r/s 

cjp  ■  11.9  Hz 

IF  »  0.22  kg-m2 

dgu  *  301  N/r/s 

£P  »  0.10 

6S  •  0  252  N-m/r/s 

dE  ■  0  006  N/r/s 

d  *  0.10  Hz 

dE  »  0  123  N-m/r/s 

dp  *  0  091  N/r/s 

c^p  *  14  7  N/r/s 

ly  ■  0  508  m 

lF  »  0  485  m 

Table  3*  .-2 

Two-Link  Arm  Identified  Parameters 

Note  The  planar  inertias,  masses,  and  link  center  of  mass  location  were 
not  explicitly  identified  The  damping  parameters  are  somewhat 
artificial  since  we  are  trying  to  fit  linear  viscous  damping  to  non¬ 
linear  Coulomb  friction  and  stiction 
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motion  used  are  described  in  Fig.  3a.-6.  For  brevity,  the  simulation  code  and  graphics  code 
are  not  included  here.  Some  of  the  interesting  results  from  the  simulations  are  included  in 
figures  3a. -7  and  3a. -8. 

Fig.  3a.-7  shows  the  graphical  output  from  the  simulation  (linearized  equations  of  mo¬ 
tion)  when  the  initial  conditions  are  such  that  the  natural  frequencies,  and  hence  the  mode 
shapes,  are  excited.  Since  the  system  is  non-linear,  there  are  different  natural  frequencies 
(and  mode  shapes)  for  each  elbow  angle  configuration.  Also,  due  to  the  two  elastic  modes 
of  the  system,  there  are  two  natural  frequencies,  designated  high  and  low,  associated  with 
each  configuration.  As  stated  earlier,  the  system  decouples  at  an  elbow  angle  of  90  degrees 
and  is  easily  seen  by  the  mode  shapes.  As  illustrated  in  the  high  frequency  regime,  the 
node  about  which  the  modal  oscillation  takes  place  starts  out  at  the  tip  and  moves  in  as 
the  elbow  angle  is  increased  to  90  degrees,  then  it  moves  out  again.  As  expected,  the  mode 
shapes  for  the  extended  arm  look  like  those  of  a  flexible  beam. 

Fig.  3a.-8  shows  the  variation  in  system  poles  and  transmission  zeros  as  a  function  of 
the  elbow  angle.  The  rigid  body  poles  are  not  shown.  The  poles  and  transmission  zeros 
are  symmetric  about  an  elbow  angle  of  90  degrees.  Also,  as  shown  in  the  figure,  the  poles 
and  transmission  zeros  change  significantly  due  to  changes  in  elbow  angle.  This  is  due  to 
the  non-linearities  of  the  system,  and  reveals  the  difficulty  in  achieving  robustness  in  the 
control  system  design. 


Control  System  Design,  Analysis,  and  Experimental  Results 

Two  different  controllers  for  the  two-link  arm  are  described  in  this  section.  The  first 
controller  described  is  a  simple  PED  colocated  controller  which  shows  the  performance  of 
the  system  without  the  use  of  the  end-point  sensor.  It  is  the  comparison  case  to  show  the 
improvements  that  end-point  sensing  provides  over  current  robot  controllers.  The  second 
controller  described  is  a  discrete,  state-space  designed  end-point  controller  which  represents 
our  best  results  to  date.  Finally,  the  effects  of  gravity  on  the  flexible  manipulator  system 
are  discussed. 

The  initial  experiments  performed  with  the  two-link  manipulator  have  concentrated 
on  studying  feedback  control  for  small  regions  of  motion  where  the  manipulator  dynamics 
is  linear  and  decoupled,  i.e.,  the  relative  elbow  angle  is  about  90°.  This  report  describes 
and  compares  two  controllers  designed  for  this  configuration.  The  first  controller  was 
designed  using  successive-loop-closure  of  rate  and  position  about  the  motor  only.  This 
represents  current  methods  of  manipulator  feedback  control  that  use  only  colocated  sensors 
and  actuators  and  do  not  compensate  for  flexibility  in  the  system.  The  second  controller 
was  designed  using  state-space  optimal  control  methods  with  the  primary  sensor  being  the 
end-point  sensor  which  was  non-colocated  with  the  motors. 


Colocated  Control 

Figure  3a.-9  is  a  block  diagram  of  a  classically  designed,  successive-loop  closure  con¬ 
troller  for  the  two-link  arm  that  does  not  use  the  end-point  sensor.  The  innermost  loop  is 
Coulomb-friction  compensated  (a  constant  torque  in  the  direction  of  rotation  of  the  motor 
is  commanded).  This  loop  successfully  reduces  the  friction  by  about  70°,  but  small  limit 
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cycles  have  appeared  during  quiescent  periods  when  motor  rates  are  near  zero.  In  the  next 
loop,  rate  is  fed  back  from  the  tachometers  located  on  the  motors  to  provide  damping  to 
the  system.  In  the  outermost  loop,  position  is  fed  back  from  the  optical  encoder  on  the 
motors.  Integral  control  is  applied  to  the  motor  position  error  signal  to  take  out  biases  in 
the  position  of  the  motor.  Note  that  the  end-point  position  can  be  in  great  error  even  if  the 
motor  positions  are  tightly  controlled.  This  is  because  any  friction,  stiction,  flexibility,  and 
disturbance  torques  located  further  down  the  drive  train  are  not  sensed  and  compensated. 
This  illustrates  one  of  the  primary  disadvantages  of  traditional  “dead  reckoning”  control 
strategies. 

Figure  3a.-10  shows  the  Evan’s  root  loci  design  for  the  rate  and  position  loops  for  both 
the  shoulder  and  elbow  sub-systems.  For  the  desired  critically  or  near  critically  damped 
closed-loop  positions  poles,  the  zeros  of  the  plant  “capture”  these  poles  near  the  origin  and 
limit  the  closed-loop  bandwidth  to  about  50°  to  60s  of  the  plant  zero  frequencies.  This 
agrees  well  with  the  traditional  “rule-of-thumb”  of  limiting  the  closed-loop  bandwidth  to 
one-half  of  the  “structural”  vibration  frequency  of  the  manipulator,  i.e.,  the  vibration 
frequency  of  the  manipulator  with  the  motors  locked,  which  corresponds  to  the  plant 
complex  zeros  for  the  colocated  transfer  function  (Equations  8  and  10).  Assuming  plant 
DC  gains  of  1.0,  the  rate  loop  gains  are  205  and  225,  and  the  position  gains  are  510  and 
810  for  the  shoulder  and  elbow  sub-systems  respectively.  The  controller  was  implemented 
on  the  PDP  11/24  digital  computer  at  a  sample  rate  of  200  Hz  which  is  very  fast  compared 
to  the  closed-loop  poles  and  thus  very  closely  approximates  continuous  control. 


Non- colocated  End-Point  Control 

Figure  3a.- 11  shows  the  block  diagram  for  the  non-colocated  state- space  controller  for 
the  two-link  arm.  At  the  time  of  this  writing,  only  the  linear  feedback  part  of  the  two-link 
state-space  control  had  been  achieved  experimentally.  The  non-linear  feedforward  part  of 
the  control  is  still  under  development.  Once  again,  an  innermost  loop  for  Coulomb  friction 
compensation  was  implemented.  A  full-state-feedback  control  law  was  designed  using  a 
Discrete  Linear  Quadratic  Regulator  design  program  called  DISC.  The  eight  states  are 
determined  by  measuring  the  motor  positions,  motor  rates  and  joint  rates  directly  and 
performing  a  kinematic  inversion  of  the  x-y  end-point  measurement  to  obtain  the  joint 
position  states.  The  steady-state,  discrete  regulator  gains  £  in  T  =  -  C  X  are  obtained  by 
minimizing  the  discretized  expression  of  the  continuous  performance  Jr- 

Jt  =  /o*(sr  A$  +  T2B)dt  (9) 

where,  for  the  shoulder  sub-system,  the  state  vector  and  control  are: 

x  =  (qs  us  qu  Uu)T 


T  =  TS 

and  for  the  elbow  sub-system,  the  state  vector  and  control  are: 


(10) 


Real  (1/s) 


Real  (1/s) 


Fig.  3a. -10  Control  Design  in  the  s-plane  using  succesive  loop  closing:  locus  of  roots  versus  rate 
and  position  gain  for  the  shoulder  and  elbow  sub-systems. 
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Fig.  3a. -11  Non- colocated  Full-state  Feedback  Control 

(Shaded  region  not  currently  implemented.) 


The  units  were  scaled  to  be:  position  q’s  in  0.01  radians,  rate  u’s  in  rad/sec,  and  torque 
T  in  0.1  N-m.  The  state  and  control  weighting  matrices  were  chosen  to  give  the  most 
weighting  to  the  tip  position  and  velocity  to  insure  good  performance  at  the  tip: 


A  =  diag(l  5  800  400),  B  =  (50)  (Shoulder) 
A  =  diag(l  5  100  200),  B  =  (50)  (Elbow) 


Using  these  weighting  matrics  for  the  shoulder  and  the  elbow  sub-systems  and  choosing  a 
sample  rate  of  50  Hz  gave  these  shoulder  and  elbow  control  matrices: 


Qs  =  (0.0019  0.3411  2.4899  26.0369) 

Ce  =  (-0.0521  0.3371  1.1723  10.7878) 

The  resulting  shoulder  closed-loop  poles  are  located  at: 

z  =  0.305  ±  0.629;,  0.796  ±  0.17;  {z  -  plane,  50 Hz) 
a  =  -17.9  ±  55.9;,  -10.3  ±  10.6;  (a  -  plane) 


(13) 


(14) 


The  resulting  elbow  closed-loop  poles  are  located  at: 

z  =  0.073  ±  0.777;,  0.812  ±  0.157;  (z  -  plane,  50 Hz) 
a  =  -12.4  ±  73.9;,  -9.56  ±  9.54;  (a  -  plane) 


(15) 


Experimental  Results 

For  comparison  of  the  two  controllers,  an  identical  step  in  end-point  position  of  35  cm 
was  commanded  to  each  controller.  Figure  3a.- 12  shows  the  response  of  both  controllers  as 
seen  in  Cartesian  x-y  space.  The  dashed  line  in  each  plot  represents  the  colocated  classical 
controller  and  the  solid  line  represents  the  non-colocated  end-point  controller.  The  top  plot 
shows  that  the  trajectories  in  x-y  space  are  roughly  equivalent  in  shape.  Neither  controller 
has  path  feedforward  so  the  paths  are  not  quite  straight  lines.  The  x  and  y  time  response 
plots  indicate  that  the  end-point  controller  slewed  to  the  vicinity  of  the  terminal  position 
in  0.2  sec  with  an  average  slew  speed  of  1.7  m/sec  whereas  the  colocated  controller  took  0.9 
sec  with  an  average  slew  speed  of  only  0.4  m/sec.  Both  plots  of  the  x  and  y  time  histories  of 
the  step  show  critical  or  near  critical  damping  in  the  response  for  the  colocated  controller 
and  the  non-colocated  controller  has  a  slight  overshoot.  The  settling  times  for  the  non- 
colocated  controller  was  about  twice  as  fast  as  for  the  colocated  controller.  (Note  that  the 
residual  oscillations  at  the  terminal  position  are  about  0.6  cm  in  amplitude,  composed,  in 
part,  of  sensor  noise  during  data  acquisition.)  The  actual  positioning  accuracy  is  about 
0.5  cm.  Increased  damping  in  the  control  design  and  further  tweaking  of  Coulomb  friction 
compensation  should  bring  the  positioning  accuracy  to  within  the  desired  0.1  cm. 

The  plots  in  Figure  3a.- 13  show  the  exact  same  step  command  as  seen  in  joint  space. 
Again,  the  dashed  lines  indicate  the  response  of  the  colocated  controller  and  the  solid  lines 
indicate  the  response  of  the  non-colocated  end-point  controller.  The  speed  of  response 
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is  about  three  to  four  times  faster  for  the  non-colocated  end-point  controller.  Note  the 
completely  different  time  histories  of  motor  position  and  commanded  torque  for  the  two 
controllers.  The  end-point  controller  commands  two  large  reversals  in  torque  during  the 
slew  maneuver.  The  motor  first  winds  up  the  springs  in  the  direction  of  travel  to  transmit 
torque  out  to  the  link.  Then  the  motor  reverses  the  torque  command  to  wind  the  springs 
in  the  direction  opposite  of  travel  to  slow  the  link  down.  Finally,  the  motor  reverses  again 
just  as  the  link  is  approaching  the  terminal  position  to  unwind  the  springs.  Residual  torque 
oscillations  damp  any  remaining  motion  in  the  links.  These  results  are  very  similar  to  those 
obtained  for  the  simple  continuously  flexible  beam  experiments  reported  by  Cannon  and 
Schmits  (except  for  the  non-minimum  phase  character  of  the  continuously  flexible  system 
which  caused  an  initial  reversal  of  tip  motion  after  a  small  time  delay  while  a  transient 
wave  propagates  down  the  flexible  beam). 


Compensating  The  Effects  of  Gravity 


There  are  two  primary  effects  of  gravity  on  our  flexible  manipulator  system.  The 
first  effect  is  large  DC  torques  that  are  a  non-linear  function  of  the  position  of  the  ma¬ 
nipulator  are  introduced.  This  effect  has,  of  course,  already  been  adequately  studied  for 
rigid  manipulators  and  can  be  compensated  using  several  well-known  techniques  including 
integral  control,  feedforward  compensation  using  calibration  data  tabulated  in  software  or 
calculated,  and  physically  counter-weighting  the  system.  The  second  effect  on  the  two-link 
flexible  manipulator  and  all  other  flexible  manipulators  is  the  change  in  dynamic  response 
of  the  system.  The  vibration  frequencies  and  mode  shapes  are  a  non-linear  function  of 
position  of  the  manipulator  in  the  gravity  field. 


We  conclude  that  compensation  for  gravity  effects  is  about  as  complex  as  the  compen¬ 
sation  required  for  the  flexibility  alone.  The  non-linear  feedforward  technique  described  for 
the  second  controller  can  be  applied  almost  directly  for  gravity  compensation  since  the  ac¬ 
curacy  of  the  plant  model  required  for  the  non-linear  dynamics  feedforward  will  suffice  for 
the  gravity  compensation.  Gravity  compensation  is  one  of  the  functions  in  the  non-linear 
feedforward  block  in  Fig.  3a.- 11. 


The  two-link  manipulator  was  constructed  so  that  gravity  effects  could  be  studied. 
The  base  plate  was  designed  to  be  tilted  up  to  15  degrees  to  include  up  to  one-fourth  of 
the  gravity  component.  As  indicated  above,  the  non-linear  feedforward  block  of  the  last 
controller  has  not  yet  been  implemented  experimentally.  Thus,  the  experimental  results 
for  gravity  compensation  will  be  reported  later. 


Summary 

This  summary  directly  addresses  the  sections  in  the  Statement  of  Work  that  pertain 
to  the  research  described  above,  namely,  sections  n  and  o.  All  of  the  objectives  have 
been  completed  at  least  to  the  level  of  theoretical  considerations  and  the  key  experimental 
results  have  been  achieved  that  positively  demonstrate  the  usefulness  of  end-point  control 
techniques  for  flexible,  multi-link  manipulators. 


Section  n.  directed  to  'extend  the  end-point  control  laws  developed  for  single-link  flex¬ 
ible  arm  operation  to  two-link  operation  in  the  horizontal  plane  and  investigate  extension 
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to  the  vertical  plane  dimensions  where  gravity  affects  the  system.* 

Both  a  classical  PID  designed  and  a  modem  state-space  designed  end-point  position 
controlled  two-link  Sexible-tendon-drive  manipulator  have  been  built  and  demonstrated. 
Advanced  control  techniques  beyond  those  developed  for  the  one-link  arm  have  been  theo¬ 
retically  analysed  and  are  close  to  experimental  demonstration.  The  effects  of  gravity  were 
considered  theoretically  and  found  to  be  fairly  complicated,  but  attainable  with  techniques 
developed  in  our  lab. 

Section  o.  directed  to  “investigate  the  capabilities  and  limitations  of  lumped-compliance 
robot  arms.  Specifically,  determine  the  slew  speed,  end  point  settling  time  and  position¬ 
ing  accuracy,  proximity  motion,  and  contact-force  performance  for  a  range  of  flexibility, 
payload  mass  and  inertia,  actuator  power,  and  controller  bandwidth;  and  study  inherent 
actuator  and  sensor  non-linearities.* 

By  “capabilities  and  limitations  of  lumped-compliance  robot  arms*,  we  realize  that 
ALL  manipulators  have  inherent  flexibility  (perfectly  rigid  structures  can  not  actually 
exist)  and  it  is  precisely  this  inherent  flexibility  that  has  impaired  robot  performance 
by  limiting  bandwidth  and  requiring  heavy,  stiff  linkages  to  be  built  to  obtain  reasonable 
accuracy.  With  end-point  control  technology,  all  of  the  above  mentioned  robot  performance 
criteria  can  be  greatly  improved.  The  increase  in  slew  speed  and  end-point  settling  time 
of  the  end-point  controlled  robot  over  the  co-located  controller  tested  was  about  a  factor 
of  3  to  4.  These  are  not  theoretical  limitations,  but  were  due  to  practical  considerations 
such  as  the  drive  belts  slipping  off  of  the  gears  if  too  much  torque  was  commanded. 

The  positioning  accuracy  can  be  easily  seen  to  have  much  better  performance  with 
direct  sensing  of  the  end-point  position  than  inferring  the  position  using  sensors  on  the 
actuatora.  Any  flexibility  in  the  drive  train  will  corrupt  the  final  estimate  of  the  end-point 
position.  The  use  of  full-state  estimators  which  model  the  flexibility  can  close  the  gap  be¬ 
tween  colocated  sensors  and  directly  sensing  the  end-point.  However,  directly  sensing  the 
end-point  position  with  a  good  sensor  (at  least  as  accurate  as  the  colocated  sensors)  repre¬ 
sents  the  asymptotic  "best*  performance  that  computer  estimators  can  possibly  achieve, 
and  the  estimators  would  need  extremely  accurate  models,  and  very  fast  computers. 

For  the  manipulator  system  we  studied,  which  did  have  stiff  links,  the  joint  sensors 
could  be  used  as  a  surrogate  to  the  end-point  sensor  since  no  significant  structural  flexibility 
lies  between  the  joints  and  the  end-point.  However,  even  in  this  case,  the  end-point  sensor 
has  five  distinct  advantages  over  the  joint  sensors.  One,  the  kinematics  of  the  robot  must 
be  extremely  well  calibrated  to  accurately  infer  end-point  position.  In  fact,  calibration 
of  joint-axis  misalignment,  link  lengths,  and  colocated  sensor  biases  represent  a  major 
expense  on  current  robots.  Even  small  collisions  can  knock  the  calibrations  out  of  whack 
and  time  and  money  must  be  spent  on  recalibration.  The  end-  point  sensor  can  be  isolated 
from  collisions  and  calibrated  just  once.  Second,  the  end-point  position  inferred  from 
joint  sensors  is  propagated  along  the  entire  chain  of  links  and  these  errors  can  grow  much 
larger  compared  to  direct  sensing.  Third,  end-point  position  inferred  from  joint  positions 
has  computational  singularities  when  the  joint-space-  to-Cartesian-space  Jacobian  becomes 
singular.  Also  the  end-point  sensor  accuracy  is  uniform  over  the  entire  operating  range 
of  the  robot  whereas  joint-position-inferred  end-point  position  accuracies  are  a  non-linear 
function  of  the  joint  space  and  deteriorate  rapidly  near  the  Jacobian  singularities.  Fourth, 
the  computational  power  required  to  compensate  flexibility  is  the  same  using  either  sensor 


system,  so  why  not  use  the  superior  end-point  sensing.  Fifth,  and  most  importantly,  end¬ 
point  sensing  can  handle  the  most  difficult  case  of  structural  flexibility  as  well  as  drive  train 
flexibility  whereas  the  joint  sensors  fail  and  stiffness  once  again  limits  the  bandwidth. 

Contact  force  performance  is  inherently  improved  for  lumped-compliance  robot  arms. 
Most  obvious  is  the  greatly  decreased  impact  forces  from  both  inadvertent  collisions  and 
desired,  but  misaligned  contact  since  the  flexible  drive  train  can  absorb  some  of  the  impact 
shock.  Also,  because  the  robots  can  be  made  much  lighter,  contact  forces  can  be  greatly 
reduced.  Experiments  on  controlled  contact  and  force  control  have  not  been  performed 
yet  on  the  two-link  arm  in  our  lab.  Equipment  is  currently  under  fabrication.  However, 
force  control  experiments  on  the  one-link  flexible  manipulator  (performed  under  DARPA) 
indicate  that  the  improved  contact  performance  achieved  on  the  one-link  arm  can  be 
transferred  to  the  two-link  arm  without  much  difficulty. 

The  modelling  and  analysis  gives  a  clearer  understanding  of  the  manipulator  perfor¬ 
mance  under  a  range  of  flexibility,  payload  mass  and  inertia,  actuator  power  and  band¬ 
width.  As  indicated  by  the  analysis,  the  plant  zeroes  (which  effectively  limit  response) 
are  primarily  a  function  of  the  drive  train  spring  constant  and  the  inertia  outboard  of  the 
springs.  Thus,  decreasing  the  spring  constant  or  increasing  the  payload  mass  and  inertia 
will  decrease  the  robot  transmission  zero  frequencies  and  the  performance. 

Actuator  power  considerations  can  be  addressed  by  considering  the  optimal  controller 
for  limited  power.  This  is  the  so-called  “bang-bang*  control  which  either  turns  the  motor 
full  forward,  full  reverse,  or  off.  As  indicated  in  the  last  section,  the  state-space  controllers 
we  studied  came  close  to  the  optimal  “bang-bang*  control.  Controller  bandwidth  for  this 
case  increases  proportionally  with  available  torque.  Thus,  it  appears  that  we  can  theo¬ 
retically  apply  almost  all  available  motor  torque  using  our  end-point  control  techniques. 
However,  for  our  robot,  the  drive  belts  slipped  long  before  full  torque  is  applied.  This  can 
be  more  carefully  considered  when  constructing  robots  for  real  applications. 

Inherent  actuator  and  sensor  non-linearities  were  carefully  studied  and  assessed  during 
our  research  since  these  represented  many  of  our  limitations.  Effective  compensation  for 
motor  friction  is  essential  for  good  control.  A  combination  of  high  loop-gain  rejection 
of  the  “friction  disturbance*  and  feedforward  compensation  of  the  friction  gave  us  good 
compensation  of  the  motor  friction.  Other  motor  non-linearities  such  as  torque  ripple 
and  cogging  torque  should  be  eliminated  at  the  outset  of  the  design  process  by  careful 
selection  of  the  motors  and  power  amplifiers.  Another  technique  we  are  planning  to  study 
will  bypass  most  of  the  actuator  non-linearity  problems  by  directly  closing  a  tight  analog 
torque  loop  between  the  motor  and  a  force/torque  sensor  on  the  joint  being  driven.  Sensor 
non-linearities  must  also  be  carefully  assesed,  especially  for  the  final  position  accuracy.  We 
achieved  acceptable  sensor  performance  by  careful  calibration  and  filtering  of  known  noise 
sources. 
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TASK  3b. 

VERY  FLEXIBLE  MANIPULATOR  WITH  FAST  WRIST 
Introduction 

In  current  robot  control  practice,  sensor  and  actuator  are  always  colocated.  Joint 
angles  are  measured  with  encoders  at  all  motor  shafts.  The  end  effector's  position  and 
direction  are  calculated  using  coordinate  transformation  from  the  set  of  joint  angle  mea¬ 
surements.  This  method  assumes  all  links  to  be  rigid,  and  the  control  bandwidth  is  chosen 
low  enough  not  to  excite  the  structural  flexibility,  which  results  in  oversized  structure  and 
very  low  control  bandwidth. 

Previous  research  in  the  Stanford  Aeronautics  and  Astronautics  Robotics  Laboratory 
in  the  control  of  flexible  manipulators  includes  :  (1)  End-point  position  control  of  a  flexible 
beam  by  Eric  Schmitz  [Schmitz  1],  and  (2)  Contact  force  control  of  a  flexible  beam  by  Jim 
Maples  [Map  1].  They  both  used  end-point  sensors  that  are  not  colocated  with  the  actuator 
to  get  high  performance.  In  order  to  design  high-performance  controllers,  they  identified 
the  linear  dynamic  model  of  the  system  and  implemented  a  state  estimator  and  state- 
feedback  regulator  using  the  LQG  modern  control  techniques.  Reduced-order  robust,  i.e., 
parameter  insensitive,  controllers  were  also  designed  to  control  the  flexible  beams.  Both 
the  LQG  modem  control  technique  and  the  reduced-order  robust  control  design  require  the 
description  of  the  plant  dynamics  in  terms  of  a  set  of  linear  equations.  The  performance  of 
the  system  under  closed-loop  control  depends  on  the  accuracy  of  the  linear  model  describing 
the  plant  dynamics  during  the  design  phase  of  the  control  system.  System  performance 
and  controller  robustness  can  be  traded  off  depending  on  the  accuracy  of  the  linear  model 
describing  the  plant  dynamics. 

Schmitz  has  found  that  there  exists  a  theoretical  limitation  on  the  control  speed, 
even  in  the  extreme  case  where  the  plant  dynamics  are  linear  and  known  exactly.  Some 
non-minimum  phase  zeros  exist  in  the  transfer  function  from  the  actuator  input  (the  hub 
motor)  to  the  tip  position  (the  end  point)  of  a  flexible  beam  due  to  the  structural  flexibility 
and  the  separation  of  the  end  point  sensor  from  the  actuator.  Those  non-minimum  phase 
transfer  zeros  limit  the  maximum  achievable  closed-loop  bandwidth.  (This  bandwidth 
limitation  is  of  course  directly  related  to  the  time  for  a  bending  wave  to  travel  the  length 
of  the  beam.) 

A  minimanipulator,  carried  by  a  main  robot  arm,  can  be  used  to  improve  the  speed 
and  accuracy  of  the  motion  of  the  end  effector.  Within  a  relatively  smaller  working  range, 
a  minimanipulator  can  achieve  higher  bandwidth  and  accuracy  due  to  its  smaller  physical 
size  and  local  actuation.  Process  time  can  be  reduced  for  jobs  requiring  frequent  small 
motions  of  the  robot  manipulator.  Large  motions  can  also  benefit,  since  the  motion  error 
of  the  main  robot  can  be  corrected  easily  with  the  minimanipulator,  and  higher  speed  of 
the  maun  robot  can  be  tolerated. 

In  isolation,  high  bandwidth  and  high  accuracy  are  not  difficult  to  obtain  for  a  mini¬ 
manipulator  due  to  its  smaller  size,  and  there  is  theoretically  no  difficulty  in  controlling  it 
with  high  bandwidth  when  it  is  mounted  on  a  fixed  base  or  carried  by  a  very  heavy  and 
rigid  robot  arm.  However,  it  becomes  more  difficult  to  obtain  fast  control  when  the  min¬ 
imanipulator  is  carried  by  a  main  manipulator  having  some  structural  frequencies  lower 
than  the  desired  control  bandwidth  of  the  minimanipulator. 

55 


TO!? 


The  idea  of  minimanipulator  has  been  considered  on  other  mechanical  systems  already. 
A  fast  and  light  secondary  mirror  has  been  be  designed  for  the  Shuttle  Infrared  Telescope 
Facility.  The  fast  motion  of  the  secondary  mirror  compensates  for  any  pointing  error  of  the 
telescope  whose  attitude  is  controlled  under  a  slow  control  system.  However,  the  mirror 
actuator  does  not  excite  the  structure,  and  thus  the  controller  design  is  not  difficult. 

Even  though  it  is  theoretically  possible  to  achieve  high  performance  for  a  control 
system  under  any  condition,  as  long  as  the  dynamics  of  the  plant  are  linear  and  known 
exactly,  a  practical  controller  design  for  such  a  system  may  not  be  feasible  due  to  the 
nonlinear  effects  and  the  modeling  uncertainty  of  the  system  dynamics.  It  is  important  to 
know  how  to  design  and  control  such  a  system  properly,  that  is,  to  get  the  high  bandwidth 
and  accuracy  inherent  in  the  minimanipulator  and  overcome  the  limitation  set  by  the 
structural  flexibility  of  the  main  robot  arm. 

Purpose  of  This  Research 

The  objectives  of  this  research  are  : 

•  To  study  and  understand  the  general  properties  o i  the  dynamic  interaction  between 
the  fast  motion  of  a  minimanipulator  and  the  structural  flexibility  of  the  main  robot 
arm. 

•  To  search  for  the  proper  way  to  design  the  mechanical  system  and  the  correct  method 
to  design  the  control  system,  in  order  to  achieve  high  performance  in  the  whole  system, 
but  still  be  insensitive  to  the  uncertainty  of  the  plant  dynamics. 

•  To  demonstrate  several  fast  maneuvers  of  the  minimanipulator  with  a  one-dimensional 
experimental  system. 

Experimental  Devices  and  System  Dynamics 

Introduction 

The  mechanical  experiment  system,  a  one-dimensional  wrist  and  flexible  beam  system, 
is  described  here.  The  rigid  and  short  wrist  represents  a  minimanipulator,  and  the  flexible 
beam  represents  the  main  robot  arm  with  structural  flexibility.  The  structural  flexibility 
of  the  main  arm  is  considered  since  it  has  modal  frequencies  lower  than  the  desired  control 
bandwidth  of  the  minimanipulator. 

Analyses  of  system  dynamics  are  also  presented.  Systems  analyzed  include:  (1)  the 
symbolic  equations  of  motion  of  a  generic  wrist-beam  system,  (2)  a  particular  wrist-beam 
model  for  a  subsequent  numerical  analysis,  and  (3)  a  linear  model  of  the  mechanical  wrist- 
beam  system  used  for  maneuver  demonstration. 

Description  of  Experimental  Devices 

A  one-dimensional  plane-motion  mechanical  wrist-and-flexible-beam  system  was  con¬ 
structed  to  study  the  basic  dynamic  behavior  of  a  mini-macro  manipulator  system  in 
which  structural  flexibility  of  the  main  arm  is  not  negligible.  This  system  was  then  used  to 


demonstrate  achievement  of  several  kinds  of  quick  maneuvers  under  feedback  control  with 
an  end  point  sensor.  A  schematic  drawing  of  the  mechanical  system  is  shown  in  Fig.  3b.- 1. 

The  wrist  is  a  16.5  cm.  long  beam  with  2.5  x  1.4  cm.  rectangular  cross  section.  It  is 
made  of  0.07  cm.  thin  aluminum  plate.  The  wrist  is  made  rigid  because  it  is  considered 
that  the  structural  flexibility  of  the  minimanipulator  can  be  neglected  due  to  its  small  size. 

A  pneumatic  gripper  with  an  inflatable  rubber  bulb,  operated  by  compressed  air  at 
40  psi,  is  mounted  near  the  far  end  of  the  wrist  in  order  to  pick  up  a  specially  designed 
object,  the  load,  for  demonstrating  maneuvering  tasks.  The  load  is  a  light  weight  spool 
shaped  object  cut  out  of  a  piece  of  aluminum  block.  A  center  hole  is  made  for  the  gripper’s 
rubber  bulb  to  insert  in,  and  the  load  is  grabbed  when  the  bulb  is  inflated. 

A  4.5  watt  incandescent  lamp  is  mounted  on  top  of  the  pneumatic  gripper  to  indicate 
the  position  of  the  end  point,  which  is  sensed  by  an  UDT  photo  sensor. 

The  other  end  of  the  wrist  is  mounted  on  the  shaft  of  a  DC  motor  which  is  capable 
of  delivering  25  oz-in  peak  torque.  An  RVDT  made  by  Pickering  is  mounted  on  the  motor 
shaft  to  measure  the  shaft  angle.  The  motor  housing  is  mounted  on  the  end  plate  of  the 
large  flexible  beam,  which  is  similar  to  the  ones  used  earlier  in  the  same  lab  for  previous 
flexible  beam  projects. 

The  flexible  beam,  which  is  06.8  cm.  long,  consists  of  two  parallel  0.1  cm.  thick  and 
6.58  cm.  high  aluminum  side  plates  connected  by  seven  rectangular  bridge  plates  with  flex 
hinges.  Those  seven  bridge  plates  link  the  two  slender  side  plates  together  so  that  the  beam 
is  stiff  in  torsion  and  vertical  bending,  leaving  the  majority  of  the  structural  flexibility  in 
the  horizontal  direction  only.  The  hub  of  the  flexible  beam  is  mounted  on  the  shaft  of  a 
limited-angle  brushless  DC  motor  attached  to  a  fixed  table.  A  potentiometer  is  mounted 
on  the  motor  shaft  to  detect  the  shaft  angle.  Four  pairs  of  strain  gauges  are  attached  to 
both  sides  of  the  right  aluminum  side  plate. 

First-order  high-pass  analog  filters  are  used  to  derive  the  pseudo-rate  information  from 
the  end  point  position  sensor  and  the  hub-motor  potentiometer,  before  sensor  output  sig¬ 
nals  are  sampled  and  digitized.  The  advantage  of  doing  so  is  that  more  sensor  information 
becomes  available  without  using  additional  sensors,  when  a  digital  computer  is  used  to 
implement  the  controller. 

Both  motors  are  installed  with  their  shaft  vertical,  allowing  only  horizontal  motion  of 
the  wrist-beam  system.  The  effect  of  gravity  is  eliminated,  since  the  long  beam  is  flexible 
only  in  the  horizontal  plane. 

Current  amplifiers  having  current  output  proportional  to  input  voltage  are  used  to 
drive  the  two  DC  motors,  so  that  motor  command  torques  can  be  directly  specified  by 
the  feedback  controller.  A  PDP-11/23  minicomputer,  running  RT-11  operating  system 
and  equipped  with  twelve-bit  A/D  and  D/A  ports,  is  used  to  implement  the  controller 
digitally. 

Dynamics  of  the  Wrist-Beam  System 

Dynamics  of  the  wrist-beam  system  are  analyzed  and  presented  in  this  section.  The 
equations  of  motion  in  symbolic  form  are  first  studied  for  a  generic  system  consisting 


of  a  uniform  flexible  beam  and  a  rigid  short  link.  This  analysis  reveals  a  fundamental 
interaction  between  a  minimanipulator  and  a  main  robot  arm  in  the  one  dimensional  case. 

The  dynamics  of  an  idealized  wrist-beam  model  is  also  analyzed  for  the  purpose  of 
subsequent  numerical  analysis.  This  model  is  chosen  such  that  the  wrist  is  very  heavy  and 
produces  large  interaction  with  the  flexible  beam.  The  size  and  mass  properties  of  this 
system  are  assumed  to  be  known  exactly,  which  makes  it  more  convenient  to  do  theoretical 
analysis  and  investigate  the  ultimate  system  performance. 

Finally,  the  dynamics  of  the  mechanical  experiment  system  are  analyzed  and  tested, 
so  that  real  time  feedback  controllers  can  be  designed. 


Equations  of  Motion  of  a  Rigid  Wrist  Carried  by  a  Uniform  Flexible  Beam 

A  generic  wrist-beam  model  is  established  for  the  study  of  the  basic  properties  of  the 
dynamic  interaction  between  the  fast  minimanipulator  and  the  structural  flexibility  of  the 
main  robot  arm.  Fig.  3b.-2  shows  a  drawing  of  this  system  and  the  free  body  diagrams 
of  its  components.  The  minimanipulator  is  considered  to  be  rigid,  and  is  represented  by 
the  short  link.  The  main  robot  arm  is  represented  by  a  uniform  beam  with  structural 
flexibility.  One  end  of  the  flexible  beam  is  attached  to  a  hub  where  a  torque  motor  is 
mounted.  Another  motor  is  located  at  the  axis  joining  the  flexible  beam  and  the  rigid 
wrist. 

Variables  used  in  the  analysis  are  defined  as: 

L :  Length  of  the  flexible  beam. 

1:  Distance  between  the  wrist-beam  joint  axis  and  the  end  effector. 
h:  Distance  between  the  wrist-beam  joint  axis  and  the  mass  center  of  the  wrist. 
y:  The  lateral  displacement  of  a  point  in  the  system. 

Bfi  The  absolute  rotation  of  the  wrist. 

6 1,:  The  hub  angle. 

It:  The  moment  of  inertia  of  the  hub,  including  the  rotor  of  the  hub  motor. 
m2:  The  mass  at  the  wrist-beam  joint  axis,  including  the  wrist  motor  stator  and  housing. 
/2:  The  moment  of  inertia  of 
02:  The  absolute  rotation  of  /2. 

m3:  The  mass  of  the  rigid  wrist,  including  the  end  effector  and  the  load. 

/3:  The  moment  of  inertia  of  m3  at  the  mass  center  of  the  wrist. 

Ui:  The  control  torque  of  the  hub  motor, 
t^:  The  control  torque  of  the  wrist  motor. 

7\:  The  reaction  torque  between  the  hub  and  the  flexible  beam. 

T2:  The  reaction  torque  between  the  flexible  beam  and  the  inertia  /2. 

F2:  The  reaction  force  between  the  flexible  beam  and  the  mass  m2. 
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Fs:  The  reaction  force  between  the  mass  m 2  and  the  rigid  wrist. 

p:  Linear  mass  density  of  the  uniform  flexible  beam. 

E:  Young’s  modulus  of  the  material  of  the  flexible  beam. 

I:  Area  MOI  of  the  cross  section  of  the  uniform  flexible  beam. 

Considering  only  small  motions  and  neglecting  any  friction  and  damping,  the  equations 
of  motion  of  the  wrist-beam  system  can  be  expressed  as: 


Ti  +  u  i  =  IiOh  =  h 


dt2dx\ 


for  the  hub, 


for  the  flexible  beam, 


2*2  +  tlj  =  — ^2^2  —  — 12 


dt2dx\ 


for  the  wrist  joint, 


F2  +  F3  =  —m2  ■ 


U2  -  Fzh  =  h9/ 


Fs  =  +  Mj) 


for  the  rigid  wrist,  with  the  boundary  conditions  for  the  flexible  beam  written  as: 


-  «1 


(8) 


EIpt 

dx 2 


=  Ti  =  I, 


d*y 


»=0 


1  dt*dx 


EIpL 

dx 2 


=  T2  =  -h 


d'y 


9~L 


dt2d  x 


-  U2 


El 


a?y 

dx 3 


=  -f2. 


Those  equations  of  motion  and  boundary  conditions  can  be  rearranged  to  get 


0Qi  4.  ei^L  ~  0 


=  0 


and 


El 


d2y 

dx* 


=  h 


d3y 


*=0 


dt2dx 


-«1 


ssO 


EI 


d2y 

dx2 


=  -/, 


x=L 


dt2dx 


-«2 


r=L 


=  (m*+ + m*h 
h  +  ms/i2ttj 


(») 

(10) 

(11) 

(12) 

(13) 

(14) 

(15) 


(/a  +  m3h3)$j  —  Vt-  m3h 


d3y 

at 1 


x=L 


(16) 


Equations  1  to  15  are  the  boundary  conditions  (BC’s)  of  the  partial  differential  equa¬ 
tion  (PDE),  Equation  11,  which  describes  the  dynamic  motion  of  the  flexible  beam.  Equa¬ 
tion  16  describes  the  dynamics  of  the  rigid  wrist.  The  PDE  and  BC’s  of  the  flexible  beam’s 
motion  are  now  decoupled  from  the  rigid  wrist’s  dynamics,  and  they  can  be  solved  sepa¬ 
rately.  The  load  to  the  free  end  of  the  beam  due  to  the  motion  of  the  wrist  is  equivalent 


to  a  point  load  with  a  mass  of  (ms/s)/(/s  +  msA2).  The  beam  is  also  subjected  to  a  lateral 
force  equivalent  to  (m5huj)/(/s  +  m3h2)  in  addition  to  the  torque  applied  at  its  free 
^  end. 

The  natural  modal  frequencies  and  shapes  can  be  found  by  solving  those  equations 
with  their  input  terms  neglected.  The  introduction  of  the  "separation  of  variables” 


y(x,t)  =  <f>(x)T{t) 

for  each  natural  mode  transforms  the  PDE  into 


(17) 


pf<(>  +  EIT4P  =  0  , 
which  can  then  be  separated  to  form 


(18) 


t  +  w2r  =  0 


(19) 


and 


9  El 9 


for  non-negative  real  cj’b.  With  the  definition  of 


(20) 


(21) 


the  solution  of  the  natural  modes  are  harmonic  motions  in  the  time  dependent  part;  and 
the  modal  shapes  are  sinusoidal  and  hyperbolic  functions  of  the  spatial  variable,  which  can 
be  expressed  as: 


<f>(x)  =  Cj  sin(/?z)  +  co&(pz)  +  cs  sinh(£x)  +  c4  cosh(/?x)  (22) 

©  while  the  following  four  boundary  conditions 


0 

II 

(23) 

BIfi  0)  =  -/lWy  (0) 

(24) 
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EI<t>"(L)  =  7,uV(i) 


(25) 


EirW  =  -(m,  +  -JZh-gM  L)  (26) 

are  satisfied.  The  modal  motion  of  the  rigid  wrist  can  then  be  derived  from  Equation  16 
as: 


e,  =  e,r(o 


where  its  modal  shape 


(27) 


msh 

/)  +  ffij  h? 


(28) 


for  w  >  0. 

With  the  ith  oscillatory  mode  shape  of  the  flexible  beam  expressed  as  <f>i(x)  and  the 
rigid  mode  shape  as  <f>0(x) ,  the  general  motion  of  the  wrist-beam  system  can  be  expressed 
in  terms  of  n  vibration  modes  and  two  rigid  body  modes  as: 


y(*»0  =  +  tfo(*)?o(0  =  0 


*=I 


t=0 


(29) 


and 


*/(<)  =  £  *,.*(<)  +  «/,(<)  =  -  +  m,h1  2  *(£)».(<)  +  »/.(<)  (30) 

where  q,(t)  represents  the  ith  modal  variable,  g0(f)  represents  the  rigid  body  modal  variable 
for  the  flexible  beam,  and  0/o(t)  corresponds  to  the  rigid  body  mode  of  the  wrist. 

In  order  to  express  the  system  dynamics  as  a  linear  differential  equation  in  the  matrix 

form 


Mq  +  Kq  =  Q ,  (31) 

the  elements  of  the  matrices  M,  K ,  and  the  column  vector  Q  have  to  be  derived  from 
either  analyses  or  tests  performed  on  the  system. 
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The  elements  M|;  of  the  mass  matrix  M  can  be  obtained  by  first  deriving  the  expres¬ 
sion  of  the  kinetic  energy 


2  Jo  Pdt)  d^  +  2Il^dtdz 

.I7ai  4.1  * 

+  2h$f  +  2  ^ai 


1 . ,  d2y 


j=0 


^  +2  ^dtdx 


)  +  \m^ 


ssL 

+**/) 


(32) 


which  can  be  expressed  in  terms  of  modal  variables  and  modal  shapes  as 


T  =\  I  p(E  0)(£  */(*)«»  (*))«** 

* Jo  i=o  y=o 

+  k(E  */(0)9.(0)(£  */(0)fc  W) 

»=o  /=o 

+ k(f:  Aumnii  hwm) 


t=0 


4=0 


(33) 


+  i/a9}  +  im,(£  «£)j,(f))(E  *,(%(<)) 


tsO 


4=0 


+  ^.(E  *(£)«*) + M,)(E  *,(£)?,•(<) + *»/) 

*  »=o  y=o 


The  elements  A/,/  is  twice  the  coefficient  of  the  term  9,-9/  in  T,  and  can  be  expressed  as: 


A/00  =  (L  p(M*))2<ix  +  Wo'(O))2  +  W(L))2 

Jo 

+  (rth  +  ms)(^o(£))2 


(34) 


Mli  =  /*  />(«*))’<!*  +  iitt/PO)’  +  I2(*.'(£))’ 

•/o 


+  (^  +  tt^tuKM^))1 


(35) 


It  +  l7JjhJ ' 


A//0  =  ij  +  TTlsh2 


(36) 


A/0,/0  =  A//o,o  =  msh<p0(L)  . 


(37) 


The  mass  for  the  rigid  body  mode  of  the  flexible  beam  can  be  expressed  as: 


Mo  =  Moo  i 


(38) 


and  for  the  ith  flexible  mode  as: 


Mi  =  Mu  .  (39) 

The  terms  Mij  vanish  for  t  j  due  to  the  orthogonality  of  modal  shapes  for  different 
natural  frequencies.  M/o  is  the  mass  of  the  rigid  body  mode  associated  with  the  rigid 
wrist,  and  the  two  terms  Mojo,  Af/o,o  represents  the  cross  coupling  mass  between  the  two 
rigid  body  modes. 

It  is  convenient  to  define  the  rigid  body  mode  shape  of  the  beam  as 


^o(x)  =  * 


(40) 


so  that 


^o'(z)  =  1 


(41) 


Mojo  =  Mfo,o  =  triohL 


(42) 


and 

rL 

Mo  =  J  pzrdx  +  Ii  +  I2  +  (m*  +  m^L3  .  (43) 

The  matrix  K  will  be  diagonal  with  K0  =  Kf0  —  0  due  to  the  orthogonality  of  the 
modal  shapes  with  distinct  natural  frequencies,  and  the  spring  stiffnesses  vanish  for  the 
two  rigid  body  modes. 

The  input  vector  Q  of  Equation  31  can  be  derived  from  the  expression  of  the  gener¬ 
alized  force 


«»=«,«(  || 


)+-*(»/-£ 


t=zL 


(44) 


which  can  also  be  written  as: 


s?  =«,  £  +M( ,  )  £  wx.)«?.(<) 

S  is  +  msA-4  fcl 

i=0 

The  elements  Q,  of  the  input  vector  Q  is  defined  by 


=  Y1  Qi6qi(t)  +  Q/o  +  69f0 


and  it  can  be  seen  from  Equation  45  that 


Qo  =  —  *h4o(L) 


Qi  =  “i^.'(o)  +  «i((4+”^w)*W  - 


<?/o  =  tij  (49) 

With  elements  of  M  and  Q  determined  previously,  Equation  31  can  be  expressed  as: 


T  Mo  Mojo  1  [  3°  1  _  [  Qo  1 
[  M/0,0  M/o  J  [0/oJ  LQ/oJ 


for  the  two  rigid  body  modes,  and 


A<i§i  +  Kiqi  =  Qi 


for  all  flexible  modes.  Values  of  Ki  can  be  related  to  the  modal  frequency  w,-  by 


=  w,-2  . 


Mi  ~  ' 

The  sensor  outputs  of  the  system  can  now  be  expressed  as: 


(53) 


6  -dy 
h~ai 


=  ?o(o + £ 

*=0  t=l 


for  the  hub  angle, 


y«(t)  =  y(£,t)  +  W/(0 

=  £9.(0  +  7‘  /, 0  g  +  »/.(*) 


(54) 


for  the  end  effector's  position,  and 


MO  =  m  -  g 


frisk 


(55) 


=  »/.(«)  -  9.(0  +  E <(-4  +  m^>*(J>  - 


for  the  wrist  axis  angle. 

It  is  important  to  examine  the  transfer  function  from  the  wrist  motor  input  u?  to 
the  end  effector’s  position  yt,  since  the  former  provides  the  most  direct  control  to  the 
latter,  which  is  exactly  the  most  important  variable  to  be  controlled.  Neglecting  the  hub 
motor  input  and  initial  conditions,  the  Laplace  transformation  applied  to  the  previously 
derived  equations  of  motion  yields 


F«(s)  l(m3(l  -  h)(h  +  X)  -  /,)  +  /(Mo  -  msX2) 
tfj(s)  a2(M0/a  +  mah2(M>  -  maX2)) 

+  Jj  T +’m,V  ~  g  MimLn~  ~  +  •  <56> 

The  coefficient  of  the  term  £  is  usually  positive  (actually  it  is  more  desirable  to  design  the 
mechanical  system  resulting  in  a  positive  term  here),  and  so  is  the  term  &(X)(fr(l.)(- 

-’(£)),  since  the  displacement  at  the  end  point  of  a  flexible  beam  4>i{L)  has  the  same  sign 
as  the  slop  <f>i(L)  there  for  all  modes,  as  can  be  seen  in  Fig.  3b.-3. 

Equation  56  can  be  rewritten  as: 


and  a  critical  length  1*  can  be  defined  such  that  the  term  (Jj  +  msh(h  -  l*))  vanishes. 

Equation  57  has  three  different  characteristics  depending  on  the  value  of  l  relative  to 
that  of  /*: 

1.  if  l  =  l*,  then 


(7S  +  msA(A  -  /))  =  0 


which  means 


Y,(s)  _  Aq2 
U2{a)  a2 


the  motion  of  the  end  effector’s  position  is  decoupled  from  the  structural  flexibility  of  the 
main  beam,  and  the  motion  is  similar  to  that  of  a  rigid  wrist  mounted  on  a  fixed  base. 
This  condition  is  the  easiest  to  control,  but  it  requires  the  relation  in  Equation  58  to  be 
satisfied  exactly. 

2.  if  l  >  1*,  then 


(fj  +  w*sA(A  —  /))  <  0 


which  means 


U2(»)  s2  £(3a  +  u/2)  ’  1  J 

and  the  motion  of  the  end  effector’s  position  is  coupled  with  the  structural  flexibility  of  the 
main  beam  in  such  a  way  that  the  motion  is  similar  to  that  of  a  colocated  sensor-actuator 
pair  in  a  flexible  structure  system.  The  system  can  be  stabilized  easily  with  high  robustness 
since  the  transfer  function  possesses  alternating  poles  and  zeros  along  the  imaginary  axis 
of  the  s-plane 

3.  if  l  <  l*,  then 


(/s  +  mjA(A-0)  >0 


which  means 


Y,(s)  V 


U2(a) 


A  2  n  sv2 

—  A°  _  V'  w 

"  «*  ki*2+“2)’ 


VW* 


and  the  motion  of  the  end  effector’s  position  is  coupled  with  the  structural  flexibility  of  the 
main  beam  in  an  unfavorable  way  that  there  is  no  longer  alternating  pole-zero  pattern  on 
the  imaginary  axis  in  the  s-plane.  The  system  becomes  difficult  to  stabilize  since  accurate 
knowledge  about  the  system  dynamics  is  required  to  design  the  feedback  controller,  and  it 
is  highly  sensitive  to  parameter  variations  in  general. 

The  physical  meaning  of  /*,  which  makes  (Js  +  msh(h  -  l*))  vanish,  can  be  explained 
with  the  free  body  diagram  as  shown  in  Fig.  3b.-4. 

There  is  little  torque  generated  by  any  of  the  two  motors  during  the  oscillatory  motion 
at  one  of  the  natural  frequencies;  but  there  is  a  reciprocal  reaction  force  transmitted 
between  the  main  arm  and  the  rigid  wrist  in  the  lateral  direction  through  the  wrist  motor 
axis.  If  the  load  at  the  end  effector  is  considered  as  part  of  the  rigid  wrist,  then  that  reaction 
force  is  the  only  external  force  applied  to  the  rigid  wrist,  and  generates  the  oscillatory 
motion  at  one  of  the  system’s  natural  frequency.  For  small  motions,  there  is  a  point  on  the 
rigid  body,  also  known  as  the  center  of  percussion,  which  remains  motionless  due  to  the 
cancellation  of  the  rotational  motion  and  the  linear  translation  at  that  particular  point. 
The  distance  between  the  motionless  point  and  the  wrist  motor  axis  is  t*  which  satisfies 
the  condition 


h  =  mW  -  h)  .  (64) 


The  location  of  the  center  of  percussion  does  not  change  with  the  magnitude  of  that 
reaction  force,  so  that  it  is  always  motionless  for  any  natural  frequency  the  wrist-beam 
system  is  oscillating  at.  It  is  quite  obvious  that  the  natural  modes  are  not  observable  by 
the  displacement  of  the  end  effector  if  it  is  located  at  the  center  of  percussion,  i.e.  if  /  =  /*. 

If  the  end  effector  is  located  further  away  from  the  wrist  motor  axis,  i.e.  /  >  /*,  then 
its  displacement  will  have  the  same  sign  as  that  of  the  wrist  axis  angle  0W,  and  this  results 
in  an  alternating  pole-zero  pattern  in  the  transfer  function  Yt(a)/U2{a)  due  to  the  fact  that 
the  wrist  axis  angle  is  really  colocated  with  the  actuator.  If  /  <  /*,  then  all  flexible  modes 
will  have  coefficients  with  different  sign  from  that  of  the  rigid  body  mode  expressed  in 
Y,(a)/U2(a). 

Appendix  G  shows  that  the  inequality  condition  as  shown  in  Equation  58,  60,  and 
62  will  not  be  changed  by  the  mass  of  the  load  carried  by  the  end  effector,  and  only  an 
increase  in  the  moment  of  inertia  of  the  load  by  the  amount  of  {msh(l  —  k)  —  Js)  or  more 
will  change  the  relations  from  Equation  58  and  60  to  Equation  62.  We  shall  consider 
only  the  effect  of  the  mass  of  the  load  in  this  analysis,  since  the  moment  of  inertia  of 
the  load  is  associated  with  the  rotation  of  the  load  which  is  not  to  be  controlled  by  the 
one-dimensional  wrist-beam  system. 

Eight  transfer  functions  can  be  defined  of  which  the  most  important  five  are  list  below 


=  60.554(a2  +  2.632)(a2  +  20.72)(a2  +  62.82) 
a2(a2  +  11.242)(a2  +  29.62)(a2  +  66.T2)  , 


y2(s)  =  e,(a) 

u2  (a)  U2(s) 

=  1009.2(a2  +  9.822)(a2  +  26.652)(a2  +  58.042) 
a2(a2  +  11.242)(a2  +  29.62)(a2  +  66.T2)  , 


(66) 


Y4(s)  =  yn(a) 

Ux{s)  Ux(a) 

=  -0.3355^  -  12.752)(a2  -  (54.7  +  ;26.91)*)(«*  -  (54.7  -  ;26.91)2) 
a2(a2  +  11.242)(a2  +  29.62)(a2  +  66.T2)  , 


(67) 


Y*(s)  = 

«M«)  Ui(s) 

=  17.1262(a2  -  8.882)(a2  -  (44.82  +  /19.98)2)(a2  -  (44.82  -  ;  19.98)2) 
a2(a2  +  11.242)(a2  +  29.62)(a2  +  66.T2)  , 


and 


(68) 


r»(«)  =  y,(f) 

ui(9)  w 

=  66.5299(a2  +  10.822)(a2  +  28.912)(a2  +  64.952)  1  ' 

a2(a2  +  11.242)(a2  +  29.62)(a2  +  66.T2)  . 

The  pole-zero  locations  on  the  a-plane  of  the  five  transfer  functions  above  are  shown 
in  Fig.  3b-5. 

It  is  shown  clearly  that  both  9*(a)/£/i(a)  and  Thcta9(s)/U2(s)  have  alternating  poles 
and  zeros  along  the  imaginary  axis  on  the  a-plane,  since  they  both  represent  the  transfer 
functions  between  colocated  actuator-sensor  pairs.  Both  Fi»(a)/tMa)  and  ©^(aj/t^a) 
have  non-minimum  phase  zeros  due  to  the  separation  of  the  sensors  from  actuators.  The 
flexible  beam  tip  position  is  better  than  the  wrist  axis  angle  when  used  to  design  the 
controller  for  the  flexible  main  beam,  since  the  former  has  higher  frequencies  for  its  transfer 
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zeros.  Y,(a)/U2(a)  has  alternating  poles  and  zero  since  /  >  /*  as  the  end  effector  is  located 
at  the  end  of  the  rigid  wrist. 


Dynamics  of  the  Mechanical  Experiment  System 

The  mechanical  experiment  wrist-beam  system  was  tested  and  analyzed  to  yield  a  set 
of  linear  equations  of  motion  to  describe  its  dynamics.  One  actuator  at  a  time  was  driven 
with  sinusoidal  currents  to  measure  the  resonant  frequencies  and  modal  shapes.  Values  of 
coefficients  related  to  the  two  rigid  body  modes  were  determined  based  on  calculations, 
due  to  the  difficulty  in  doing  frequency  response  tests  at  DC  frequency.  Dampings  were 
neglected  and  two  natural  modes  along  with  the  two  rigid  body  modes  were  included  in 
the  system’s  model. 

Cunrent  amplifiers  are  used  to  drive  the  two  motors,  so  that  the  torques  developed  are 
proportional  to  the  voltage  inputs  sent  to  the  amplifiers.  Including  all  actuators,  sensors, 
amplifiers,  and  the  mechanical  system  as  the  “plant* ,  the  plant’s  inputs  and  outputs  are 
expressed  in  units  of  volts  and  it’s  dynamics  are  expressed  in  modal  state  form  as: 
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are  the  natural  frequencies,  vx  and  v3  are  the  voltage  inputs  to  the  current  amplifiers 
driving  the  hub  and  wrist  motor  respectively,  and  v,fl  to  vtt4  are  the  four  strain  gauge 
outputs. 


The  wrist  motor  has  little  controllability  over  the  first  natural  mode  and  the  wrist  axis 
angle  has  little  observability  for  the  same  mode  either,  since  the  wrist  motor  is  mounted 
on  the  end  plate  of  the  flexible  beam  and  that  end  plate  does  not  rotate  with  the  side 
plates  of  the  beam  at  the  first  mode.  However,  the  second  mode  is  still  disturbed  by  the 
wrist  motor. 


Neglecting  the  flexible  modes,  the  transfer  functions  from  the  wrist  motor  to  the  wrist 
tip  position  and  to  the  wrist  axis  angle  are: 
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The  equations  of  motion,  Equation  70  and  71,  are  the  best  estimates  from  tests  and 
calculations,  but  they  still  do  not  agree  with  some  of  the  tests  performed  due  to  the 
following  two  difficulties  in  doing  the  system  identification: 


1.  The  system  has  two  rigid  body  modes  and  two  control  inputs  (actuators)  and  the 
system  (wrist  and  beam)  drifts  away  from  the  reference  position  in  these  two  modes 
during  tests  for  dynamic  identification. 


There  is  unmodeled  nonlinearity  of  the  system  caused  by  the  geometric  second  order 
effect  and  by  friction  at  the  wrist  motor  shaft.  These  nonlinearities  introduce  compo¬ 
nents  of  higher  frequency  harmonics  when  the  system  input  is  excited  by  a  sinusoidal 
signal.  These  nonlinearities  also  affect  the  amplitude  of  the  output  signals  making 
them  not  proportional  to  the  input  signals. 


This  poses  a  challenge  to  the  control  design,  it  must  be  as  less  sensitive  to  the  plant 
variation  as  possible. 


Controller  Design  Analysis  And  Evaluation 

One  of  the  goals  of  this  research  is  to  demonstrate  several  fast  maneuvers  of  the 
minimanipulator  with  the  wrist-beam  mechanical  system.  The  control  system  can  be 
designed  with  different  methods,  resulting  in  different  performances  to  command  responses 
and  different  sensitivities  to  variation  in  system  parameters.  It  is  important  to  examine 
different  controller  designs,  compare  their  ultimate  performances  and  their  sensitivities,  so 
that  the  best  one  can  be  suggested  and  implemented  for  the  demonstration. 

A  numerical  analysis  based  on  an  ideal  and  linear  wrist-beam  model  can  serve  that 
purpose  most  properly.  A  perfect  knowledge  about  the  system  dynamics  can  be  assumed 
during  the  analysis  to  compare  the  theoretical  ultimate  performances  of  different  controller 
designs.  Effects  of  regulators  and  state  estimators  can  be  separated  due  to  the  availability 
of  all  the  system  state  information.  System  sensitivity  can  also  be  studied  by  varying  the 
system  parameters  selectively. 

Equations  65  to  69  are  used  as  the  "plant*  for  the  numerical  analysis  described  in  this 
chapter.  This  model  is  assumed  to  have  a  heavy  wrist  which  results  in  a  large  interaction 
between  the  fast  wrist  motion  and  the  structural  flexibility  of  the  main  beam.  The  large 
interaction  represents  the  worst  case  and  makes  this  analysis  more  general  and  covers  more 
possible  practical  designs  in  the  future. 

Different  types  of  regulators  are  compared  first  for  their  performances,  since  an  ideal 
state  estimator  should  be  able  to  reconstruct  all  the  system  state  variables  (regardless  of 
what  states  are  actually  to  be  fed  back).  Regulators  designed  with  the  modern  control 
technique  (LQG),  with  the  pole-placement  method,  and  with  a  direct  end-point  feedback 
method  are  compared. 

Two  regulator  design  methods  are  selected  based  on  the  comparison,  and  state  esti¬ 
mators  are  designed  for  those  two  regulators  accordingly.  The  performances  of  the  estima¬ 
tors,  and  those  of  the  overall  control  systems,  are  then  compared.  A  control  system  design 
method  is  suggested  as  the  result  of  the  analysis. 


Closed  Loop  Response 

The  dynamics  of  the  whole  system  can  be  studied  when  the  equations  of  motion  of  the 
plant,  the  regulator,  and  the  estimator  are  combined  for  analysis.  System  sensitivity  to 
plant  variations  can  also  be  analyzed  when  some  parameters  are  changed  in  the  equations. 

The  dynamics  of  the  regulator  and  that  of  the  estimator  are  no  longer  separated  when 
the  plant  varies,  or  when  a  reduced  order  estimator  is  used  instead  of  a  full  order  one. 
Step  command  responses  are  simulated.  The  system  output  errors  due  to  disturbances  are 
also  studied. 

The  performances  of  the  closed  loop  systems  with  different  controller  designs  are 
compared  and  the  best  controller  design  is  suggested. 


LQG  Regulator  and  Estimator 

Figure  3b.-8  shows  the  system  output  responses  to  a  step  command  and  to  impulsive 
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disturbance  inputs.  There  is  not  too  much  difference  whether  the  flexible  main  beam’s  tip 
position,  Fig.  3b. -8b,  or  the  wrist  axis  angle,  Fig.  3b.-8c,  is  used  as  sensors  for  the  state 
estimation.  However,  the  error  of  the  system  outputs  due  to  disturbances  are  much  larger 
than  the  errors  of  the  state  estimation  as  shown  in  Fig.  3b.-6  and  Fig.  3b.-7. 

Direct  End-Point  Feedback  for  the  Wrist  Motor  Loop 

The  closed  loop  system  responses  will  be  different  than  those  of  the  regulator  and  of 
the  estimator  separately,  since  a  reduced  plant  model  is  used  in  the  designs.  Step  command 
and  impulsive  disturbance  responses  are  simulated  and  shown  in  Fig.  3b.-9. 

The  step  command  responses  are  similar  to  those  of  the  full  state  regulator  design, 
and  the  use  of  the  reduced  system  dynamics  in  the  controller  design  is  thus  justified.  The 
wrist  tip  position  response  is  slightly  better  when  the  flexible  beam’s  tip  position  is  used  for 
the  hub  motor  loop  control  than  when  the  wrist  motor  axis  angle  is  used.  No  estimation 
error  is  investigated  here  since  an  estimator  based  on  a  reduced  system  model  cannot 
really  estimate  all  state  variables  of  the  system.  But  the  system  output  error  due  to  some 
disturbances  can  still  be  calculated,  and  they  are  shown  in  Fig.  3b.-9c  and  d. 

Comparison  of  Disturbance  Responses 

The  system  output  responses  to  the  step  commands  are  similar  for  both  the  all-LQG 
design  and  for  the  direct  end-point  feedback  designs,  and  the  use  of  the  state  estimator 
does  not  degrade  too  much  from  the  full  state  feedback  designs.  The  system  responses 
due  to  the  impulsive  disturbances  have  also  been  investigated,  and  a  comparison  between 
different  controller  designs  reveals  some  important  results. 

The  main  purpose  is  to  control  the  wrist  tip  position,  and  the  simulation  has  shown 
that  the  disturbance  from  the  wrist  motor  has  larger  effect  than  that  from  the  hub  motor 
with  identical  magnitude.  The  errors  of  the  predicted  wrist  tip  position  based  on  the 
estimated  states  are  compared  and  shown  in  Table  3b.- 1  which  indicates  that  the  all-LQG 
design  results  in  a  better  state  estimation  since  the  wrist  tip  position  sensors  are  not  used 
for  state  estimation  in  the  direct  end-point  feedback  controller.  The  errors  of  the  actual 
wrist  tip  position  are  also  compared  in  the  same  table,  which  shows  a  result  opposite  to 
that  of  the  position  estimation:  and  of  course  it  is  the  performance  of  the  actual  wrist 
tip  -  not  of  the  estimator  -  that  is  important.  The  direct  end-point  feedback  controller 
results  in  less  wrist  tip  position  error  because  the  wrist  motor  loop  uses  the  actual  wrist 
tip  position  and  rate  for  feedback  control  instead  of  using  the  estimated  state  as  in  the 
all-LQG  controller  design. 

The  comparisons  also  show  that  there  is  not  much  difference  between  the  sensor 
selections. 

Variation  of  Plant  Dynamics 

Any  change  or  unmodeled  part  of  the  plant  dynamics  will  influence  the  system  per¬ 
formance,  and  even  destabilise  the  closed  loop  system.  Parameters  describing  the  system 
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Fig.  3b. -6:  The  dynamic  wpcMW  of  the  LQG  estimator  to  impulsiee  disturbances  from 
(a)  tbs  wrist  motor  and  (b)  the  bob  motor.  The  main  beam’s  tip  position  and  the  other 
three  season  are  used  for  the  estimator  feedback. 
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Fig.  3b. -7:  The  dynamic  responses  o ( the  LQG  estimator  to  impulsrre  disturbances  from 
(a)  the  wrist  motor  and  (b)  the  hub  motor.  The  wrist  axis  angular  position  and  the  other 
three  sensors  are  used  for  the  estimator  feedback. 
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Fig.  sb.-8i  The  step  command  and  impulsive  disturbance  response  of  the  system  with 
LQG  regulator  and  estimator  (a)  step  command  in  wrist  tip  position;  and  impulsive  wrist 
motor  disturbances  when  (b)  the  flexible  beam  tip  position,  or  (e)  the  wrist  axis  angle  is 
used  with  other  three  sensors. 
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Fig.  Sb.-O:  The  (tep  command  (  (a)  and  (b)  ),  and  impulsive  disturbance  (  (c)  and  (d)  ) 
response  of  the  system  with  reduced  LQG  regulator  and  estimator,  when  the  wrist  motor 
loop  is  dosed  with  direct  end-point  feedback.  ( (a)  and  (c)  use  flexible  beam’s  tip  position 
and  hub  rate  sensors,  (b)  and  (d)  use  wrist  axis  angle  and  hub  rate  sensors.) 
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dynamics  can  be  varied  arbitrarily  to  investigate  their  influences. 

The  structure  stiffness  of  the  flexible  main  beam  is  considered  to  be  the  most  important 
parameter  in  this  study,  and  analysis  is  performed  to  investigate  the  system  sensitivity  to 
this  parameter.  It  is  found  lowering  the  stiffness  by  fifteen  percent  will  start  destabilizing 
the  system  with  any  of  the  controller  design,  and  this  high  sensitivity  is  believed  due  to  the 
estimator  part  of  the  controller.  However,  the  direct  end-point  feedback  control  scheme 
can  use,  for  the  hub  motor  loop,  slower  controller  which  is  less  sensitive  but  does  not 
degrade  the  wrist  tip  position  response.  Besides,  it  is  much  easier  and  more  accurate  to 
test  the  system  and  identify  its  dynamics  after  the  wrist  motor  loop  is  closed,  if  a  high 
performance  hub  motor  loop  controller  is  required. 


Conclusion  from  the  Numerical  Analysis 

A  direct  end-point  feedback  controller  for  the  wrist  tip  position  control  is  recom¬ 
manded  based  on  the  analysis  above.  It  has  the  same  nominal  performance  as  obtained 
from  other  prominent  controller  designs,  and  it  will  not  be  degraded  by  parameter  uncer¬ 
tainties  or  by  the  controller  chosen  for  the  flexible  main  beam.  The  controller  design  for 
the  main  beam  can  be  based  on  a  suitable  compromise  between  performance  and  robust¬ 
ness,  which  allows  a  good  practical  design  even  in  the  absence  of  a  very  accurate  model 
for  the  system  dynamics. 


Experimental  Control  Designs,  Results  And  Demonstrations 

The  direct  end-point  feedback  scheme  is  selected  for  the  controller  design  of  the  me¬ 
chanical  experiment  device,  due  to  the  analysis  results  from  Controller  Designs  Analysis 
and  Evaluation  and  the  fact  that  the  dynamic  model  described  in  Dynamics  of  the  Mecha- 
nial  System  may  not  be  very  accurate. 

The  procedures  for  and  the  results  from  the  feedback  controller  designs  are  described 
in  this  chapter.  Maneuvers  of  the  mechanical  system  are  also  recorded. 


The  Feedback  Controller  Designs 

Several  controller  designs  are  described  in  this  section.  Different  controllers  are  re¬ 
quired  for  different  operational  modes.  They  also  result  in  different  performance,  and 
require  accordingly  different  accuracy  in  the  modeling  of  the  system  dynamics. 

Not  all  sensors  considered  in  the  earlier  numerical  analysis  are  implemented  in  the 
mechanical  experimental  system.  A  photo  sensor  is  used  to  measure  the  wrist’s  tip  position, 
but  its  velocity  is  not  measured.  A  RVDT  is  installed  at  the  wrist  motor  axis  to  measure 
its  angle,  but  no  position  sensor  is  implemented  to  measure  the  tip  position  of  the  flexible 
main  beam.  The  hub  angle  rate  information  is  obtained  by  high  passing  the  angular 
position  sensed  by  a  potentiometer.  Four  pairs  of  strain  gauges  are  mounted  along  the 
sides  of  the  flexible  main  arm.  They  are  used  to  help  identify  the  numerical  values  in  the 
model  of  the  system’s  flexibility,  but  are  not  used  in  the  real  time  feedback  control. 


Wrist  Motor  Loop  Closed  with  Wrist  Tip  Position  Measurement 

The  wrist  motor  is  controlled  using  feedback  from  the  wrist  tip  position  sensor  when 
the  wrist  tip  is  in  the  vicinity  of  the  target  position. 

Wrist  Motor  Loop  Controller  Design 

Neglecting  the  flexible  modes,  the  transfer  function  from  the  wrist  motor  to  the  wrist 
tip  position  can  be  approximated  as 
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as  shown  in  Equation  74.  It  is  discovered  from  many  trials  that  a  sample  rate  as  fast  as 
100  Hz  is  needed  to  control  this  system  in  order  to  get  desirable  response.  The  transfer 
function  expressed  in  the  sampled  time  domain  becomes 
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and  a  lead  compensator 


U2(z)  18(*  -  0.85) 

Yu(z)~  (*-0.55) 

where  y(c  is  the  wrist  tip  position  error  calculated  from 
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Vu  =  yu-yt  (79) 

can  be  used  to  control  the  wrist  tip’s  motion.  The  root  locus  of  the  closed  loop  pole 
locations  versus  the  feedback  gain  is  shown  in  Fig.  3b.- 10. 

The  compensation  as  shown  in  Equation  78  results  in  the  closed  loop  poles  at  (0.856  ± 
j 0.274)  and  0.75  on  the  z-plane,  which  are  equivalent  to  (-10.67  ±  j'30.98)  and  —28.7  on 
the  s-plane,  or  bandwidths  at  5.21  Hz  and  4.6  Hz  respectively.  The  step  response  of  the 
wrist  tip  position  is  shown  in  Fig.  3b.- 11. 

An  overshoot  is  observed  since  the  closed  loop  system  damping  is  0.33  only. 

Hub  Motor  Colocated  Feedback  Control 

The  flexible  main  beam  can  be  controlled  by  the  hub  motor  with  colocated  sensor 
feedback  when  the  dynamics  of  the  flexible  main  beam  are  not  known  very  well.  Both  the 
lead  compensation 
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Fig.  3b.-  10s  The  root  locos  of  the  closed  loop  pole  location  versus  the  loop  gain,  for  the 
wrist  motor  control  loop  using  the  wrist  tip  position  sensor  with  lead  compensator. 
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|  running  at  100  Ez  where  is  the  hub  angle  error  calculated  from 
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and  the  position-plus-rate  feedback 
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are  obtained  from  several  trials.  These  result  in  a  slow  but  robust  controller  for  the  flexible 
main  beam.  The  step  response  is  shown  in  Figs.  3b.- 12  and  13. 

The  flexible  main  beam  is  given  a  command  to  follow  the  wrist  tip  and  keep  the  wrist- 
beam  system  aligned  at  all  times.  Fig.  3b.- 12a  shows  the  wrist  tip  position  being  identical 
to  that  shown  in  Fig.  3b.- 11;  and  this  test  demonstrates  that  the  wrist  tip  response  is 
independent  of  the  motion  of  the  flexible  main  beam.  Fig.  3b.-12b  shows  the  hub  motion 
of  the  flexible  main  beam,  when  the  hub  motor  is  controlled  with  a  lead  compensator.  The 
lead  compensator  results  in  an  underdamped  system,  and  the  hub  overshoots  in  the  step 
motion.  Fig.  3b.-12c  shows  the  hub  motion  when  the  hub  motor  is  controlled  with  the 
position-plus-rate  feedback.  The  overshoot  in  the  hub  angle  is  eliminated  due  to  the  hub 
rate  feedback,  even  though  the  rate  information  is  derived  from  the  hub  position  signal. 
The  second  structural  mode  is  excited  by  the  wrist  motor  during  the  step  command,  and 
Fig.  3b.-  12b  and  12c  show  the  appearance  of  that  mode  in  the  motion  of  the  main  beam. 


Fast  Controller  Design  for  the  Flexible  Main  Beam 

A  fast  controller  for  the  flexible  main  beam  can  be  designed  based  on  the  dynamic 
model  identified  in  the  last  section.  An  LQG  design  algorithm  is  used  to  design  the 
regulator  and  estimator. 

The  regulator  is  designed  in  the  continuous  time  domain  with  the  penalty  weightings 
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for  the  hub  motor  control  input,  and 
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Fig.  3b. -13:  The  recorded  step  response  of  the  wrist-beam  system  using  the  colocated  sensor 
for  the  hob  motor  control  feedback:  (b)  with  lead  compensator,  (e)  with  positkm-phia-rate 
feedback. 
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Fig.  Sb.-13:  Photograph  sequence  of  the  step  response  of  the  wrist*beam  system  using  the 
wrist  tip  position  sensor  end  a  lead  compensator  for  the  wrist  motor  feedback  control. 
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for  the  six  state  variables.  The  wrist  motor  axis  angle  has  a  very  small  observability  for 
the  first  flexible  mode,  which  will  result  in  a  regulator  leaving  that  mode  uncontrolled  if 
only  the  wrist  motor  axis  is  penalised  in  the  regulator  design.  It  turns  out  that  penalising 
errors  of  all  the  modes  produce  a  better  regulator  in  this  particular  case. 

The  regulator  feedback  gain  obtained  is 


if  =[145.72  41.253  110.82  7.5273  222.74  3.6613] 
which  results  in  the  closed  loop  poles  at 
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-  4.677  ±j 23.25 

-  9.889  ±  >9.705 

-  5.465  ±  >6.083 

and  a  corresponding  bandwidth  of  1.3  Hs,  which  should  be  compared  with  the  beam’s  first 
cantilever  natural  frequency  of  0.55  Hs!  The  continuous  regulator  feedback  gain  K  can  be 
used  directly  in  a  digital  implementation  without  causing  too  much  error  as  long  as  the 
sample  rate  is  not  too  slow. 

The  estimator  is  designed  in  the  discrete  time  domain  since  the  system  dynamics  and 
the  sensor  feedback  gains  have  to  be  transformed  into  the  discrete-time  format  when  they 
are  implemented  into  a  digital  estimator.  The  computation  time  required  for  the  state 
estimation  limits  the  sample  rate  to  25  Hs,  so  that  the  the  implementation  of  the  feedback 
control  for  the  whole  system  is  running  at  multiple  clock  rates  -  25  Hs  for  the  estimator 
and  100  Hs  for  the  wrist  loop. 

The  wrist  motor  axis  angle  and  the  hub  angular  rate  are  used  as  the  sensor  outputs 
for  the  estimator  design.  The  hub  rate  information  is  actually  derived  by  sending  the  hub 
angular  position  measurement  through  a  high-pass  analog  filter.  The  system  dynamics  of 
the  plant  is  therefore  augmented  to  include  that  filter  in  order  to  reduce  the  estimation 
error. 

The  system  dynamics  can  be  expressed  in  the  discrete  time  domain  as 
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and 


r  = 


4.29  x  10“4 
2.14  x  10~2 
1.35  x  10“* 
6.60  x  10“2 
1.01  x  10~* 
4.63  x  10~2 
-7.61  x  10-1 


Choosing  the  noise  covariance  values 


(89) 


Qe  =  1.6525  x  10' 
for  the  process  noise  coming  from  the  hub  motor,  and 


(90) 


„  _  f  1.325  x  10'  0 

"*“  1  0  5.4483  xlO*. 


for  the  two  sensor  outputs,  the  estimator  feedback  gain  matrix 


1  = 


-3.516  x  10"* 
-1.778  x  10"2 
-7.18  x  10-4 
5.804  x  10-' 
-8.744  x  10"4 
-5.698  x  10"* 
1.579 


-5.5  x  10-' 
-3.093  x  10-* 
-5.52  x  lO"4 
-2.788  x  10“2 
-3.42  x  lO"4 
-1.741  x  10"2 
1.516  x  lO-1 


(91) 


(92) 
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A  A-* 


is  obtained  with  corresponding  closed  loop  poles 


0.5528  ±  /0.7131 
0.692  ±  ;0.3417 
0.826  ±  j'0.2035 
0.0911 


(93) 


on  the  z- plane,  or  equivalent  pole  locations 


-  2.572  ±  j  22.78 

-  6.476  ±j  11.46 

-  4.039  ±;6.038 
-59.90 


(94) 


on  the  s-plane.  This  estimator  has  a  bandwidth  of  1.16  Hs. 

The  motion  of  the  flexible  main  beam  becomes  faster  when  the  LQG  optimum  con¬ 
troller  is  used.  A  step  response  is  recorded  in  Fig.  3b.- 14.  The  hub  moves  back  and  forth 
in  order  to  provide  the  optimum  motion  control,  as  revealed  by  Schmits.  The  speed  of  the 
motion  of  the  flexible  main  beam  is  increased  by  two  to  four  times,  as  compared  to  those 
shown  in  Fig.  3b-12.  Fig.  3b.- 14  also  shows  an  improvement  of  the  wrist  tip’s  motion. 


Plant  Dynamics  Switching 

The  system  dynamics,  with  the  wrist  loop  closed,  changes  as  the  wrist  motor  loop 
controller  switches  when  the  tip  position  approaches  or  leaves  the  target  position.  The 
estimated  state  variables  must  be  initialised  to  reduce  the  transient  effect. 

It  is  assumed  that  the  true  state  and  outputs  of  the  system  do  not  change  abruptly 
when  the  wrist  control  mode  switches.  The  four  pairs  of  strain  gauges  provide  mode  shape 
information  about  the  system  which  is  shown  in  the  output  matrices  H.  They  can  be  used 
to  calculate  the  transition  matrix  for  the  state  variable  initialisations. 


Conclusions  and  Suggestions  for  Further  Research 

The  research  reported  here  is  a  theoretical  and  experimental  investigation  of  a  robotic 
concept,  conceived  by  the  author,  where  a  quick-acting  wrist  is  carried  by  a  large,  very 
flexible  manipulator  arm.  Making  the  arm  very  flexible  enable  us  to  study  the  structural 
flexibility  easily,  and  investigate  controllers  with  bandwidth  higher  than  the  structural 
frequency.  Once  we  have  learned  how  to  control  a  robotic  system  faster  than  its  natural 
modes,  we  will  be  able  to  use  robots  that  are  less  rigid  in  structure,  and  therefore  lighter, 
to  achieve  higher  accuracy  and  faster  motion  with  less  power  consumption  at  a  lower  cost. 
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Conclusions 

The  following  conclusions  can  be  drawn  from  the  research  described  in  this  report: 

1.  Both  the  theoretical  analysis  and  maneuver  demonstrations  using  a  one-dimensional 
mechanical  system  show  the  feasibility  to  control  a  mini- manipulator  at  a  bandwidth 
several  times  higher  than  the  structural  flexibility  of  the  main  manipulator,  with  the 
use  of  end-point  sensors. 

2.  It  has  been  discovered  and  demonstrated  that  the  location  of  the  end  effector  relative 
to  that  of  the  center-of-percussion  of  the  minimanipulator  is  important.  A  proper  me¬ 
chanical  design  can  avoid  non-minimum  phase  zeros,  so  that  a  robust,  high-bandwidth 
controller  can  be  implemented. 

3.  A  comparison  of  different  controller  design  methods  in  the  numerical  analysis  reveals 
that : 

a.  Pole-placement  control  design  results  in  the  best  response  only  if  the  system  is 
perfectly  linear  and  an  exact  knowledge  about  the  system  dynamics  is  available. 
Otherwise,  its  performance  is  no  better  than  the  optimal  control  (LQG)  design. 

b.  Optimal  control  (LQG)  design  produces  good  response,  and  is  recommended  if 
truly  good  knowledge  about  the  system  dynamics  is  available.  However,  its  per¬ 
formance  and  stability  are  quite  sensitive  to  plant  variations  or  modeling  errors. 

c.  Direct  end-point  feedback  control  for  the  minimanipulator  has  tip-position  re¬ 
sponses  similar  to  those  of  the  LQG  design.  It  is  much  more  desirable,  however, 
because  (a)  it  is  much  less  sensitive  to  incorrect  knowledge  about  plant  param¬ 
eters,  (b)  its  response  does  not  degrade  when  a  low  performance  controller  is 
chosen  for  the  main  manipulator,  and  (c)  it  is  much  easier  to  test  the  system 
dynamics  with  the  inner  loop  closed  if  a  high  performance  controller  for  the  main 
manipulator  is  desired.  This  method  is  especially  recommended  when  uncertainty 
exists  about  the  plant’s  dynamics.  The  plant  dynamics  changes  with  the  inner 
loop  control  mode,  and  the  controller  for  the  main  manipulator  has  to  be  modified 
accordingly. 

4.  The  importance  of  using  end-point  feedback  is  demonstrated.  It  will  be  impossible  to 
achieve  high  performance  under  modeling  uncertainty,  without  the  proper  usage  of  at 
least  one  end-point  sensor. 


TASK  3c. 

STRATEGIES  FOR  TASK  COMMAND  AND  CONTROL 
OF  TWO-LINK  MANIPULATORS 


Two  separate,  rather  extensive  contributions  were  made  to  this  area  during  the  year 
by  Bruce  Gardner  and  Avi  Weinreb.  Both  were  sponsored  by  this  AFOSR  Contract,  and 
both  culminated  this  year  in  Ph.D.  theses  which  are  available  as  SUDDAR  reports,  [Refs. 
6  and  7]. 

Gardner’s  early  results  were  reported  in  [Ref.  2,  pp.41-46].  An  update  summary  is 
reported  here: 


Strategies  for  Moving  Target  Capture 

An  analytic  design  study  is  conducted  to  demonstrate  circumstances  under  which  the 
inclusion  of  feedforward  compensation  in  a  target* tracking  control  scheme  can  be  expected 
to  offer  significant  performance  gain  (e.g.,  enough  to  justify  cost  implementation).  In 
particular,  a  target-tracking  controller  design  problem  for  a  mechanical  arm  is  developed 
to  assess  quantitatively  the  capacity  of  feedforward  to  provide  a  quicker,  more  accurate 
tracking  response  over  wide  ranges  of  uncertainty  or  variability  in  the  dynamic  parameters 
of  both  plant  and  target. 

The  Stanford  Aeronautics  and  Astronautics  Department  Robotics  Lab  two-link,  two- 
actuator  mechanical  arm,  inherently  a  system  with  variable  kinematic  and  dynamic  pa¬ 
rameters,  provides  an  appropriate  framework  for  this  study.  Using  recent  developments  in 
the  theory  of  quadratic  synthesis  of  robust,  low-order  “optimal*  controllers,  control  logic 
is  developed  —  both  with  and  without  feedforward  —  that  enables  the  arm  end-point  to 
track  a  physical  target  characterized  in  part  by  periodic  motion  of  variable  or  uncertain 
frequency  and  phase. 

It  is  shown  that,  using  relatively  noise-free  measurements  of  target  position  coordi¬ 
nates  only,  feedforward  compensation  can  be  expected  to  provide  substantial  reductions  in 
tracking  errors  for  given  constraints  on  control  effort,  particularly  when  the  range  of  vari¬ 
ation  in  target  frequency  is  large.  As  noise  levels  in  the  position  measurements  increase, 
the  relative  improvement  in  tracking  accuracy  (for  a  given  level  of  control  effort)  offered 
by  feedforward  decreases.  However,  if  target  rate  coordinates  are  also  measured  and  used 
in  the  feedforward  control  scheme,  the  improvement  is  shown  to  be  considerable  even  for 
fairly  high  noise  levels  in  target  measurements. 

Experimental  verification  of  the  predicted  results  contained  herein  is  scheduled  for  the 
near  future. 


Strategies  for  Optimal  Control  with  Multiple  Bounded  Inputs 

Several  aspects  of  optimal  control  of  systems  with  multiple  bounded  inputs  are  con¬ 
sidered. 

A  connection  between  the  structure  of  multi-input  systems  and  the  existence  of  mini- 


mum  time  solutions  with  singular  controls  is  identified.  It  is  shown  that  systems  which  are 
decoupled  or  one-way  coupled  may  have  (depending  on  the  boundary  conditions  specified) 
some  singular,  non-unique  control  components  as  part  of  the  minimum-time  solutions. 

A  new  algorithm,  which  extends  the  basic  gradient  algorithm  to  optimal  control  prob¬ 
lems  with  bounded  controls  is  presented.  When  necessary,  the  resulting  controls  asymp¬ 
totically  use  all  the  available  control  range,  without  violating  the  control  bounds.  The 
algorithm  uses  an  adjustable  control  weight  to  enforce  the  control  bounds. 

Using  the  new  algorithm,  the  minimum-time  control  problem  of  a  two-link  robot  arm 
is  solved,  using  an  exact  rigid  body  model  and  bounded  controls.  The  problem  is  solved 
both  for  the  given  end-points  case  and  for  the  new  given-distance/unknown  end-points 
case.  The  solutions  provide  new  insight  into  the  dynamic  characteristics  of  the  robot  arm, 
pertaining  both  to  path  planning  and  design  specifications. 


TASK  3d. 

ADAPTIVE  CONTROL 


Rationale 

The  achievement  of  high-performance  control  for  complex,  flexible  mechanisms  such 
as  robot  arms  depends  on  the  control  computer  having  good  quantitative  understanding, 
i.e.,  a  good  mathematical  dynamic  model  for  the  system  to  be  controlled.  In  a  robot  there 
is  the  central  difficulty  that  various  important  parameters  influencing  system  dynamics 
will  change  during  the  course  of  system  operation.  An  obvious  example  is  a  robot  arm 
picking  up  a  payload:  the  weight  of  the  payload  can  significantly  alter  the  dynamics  of 
the  arm.  To  achieve  the  best  possible  performance  from  the  control  system  for  such  a 
mechanism,  it  is  necessary  to  identify  changes  in  significant  system  parameters  while  the 
system  is  in  operation.  The  identified  changes  can  then  be  used  to  update  the  controller 
design,  again  while  the  system  is  in  operation,  in  order  to  optimize  performance.  This  is 
the  essence  of  adaptive  control.  We  have  undertaken  the  development  and  testing  of  such 
control  systems  for  physical  systems  available  in  the  manipulator  research  laboratory. 


Description  of  First  Experimental  Mechanical  System 

As  a  first  step,  we  have  developed  algorithms  for  adaptive  control  of  a  physical  system 
previously  built  for  the  purpose  of  investigating  problems  in  the  control  of  flexible  struc¬ 
tures  with  non-colocated  sensors  and  actuators.  It  is  an  experimental  system  designed  to 
test  most  severely  any  adaptive  control  scheme.  This  system  consists  of  four  steel  disks 
connected  to  a  central  torsion  spring  (see  Fig.  3d.-  1).  RVDT  sensors  measure  the  angular 
displacement  of  each  disk,  and  a  brushless  DC  torque  motor  mounted  on  the  second  disk 
from  the  top  provides  the  control  input.  The  polar  moment  of  inertia  of  the  top  disk 
can  be  abruptly  changed  while  the  system  is  being  controlled.  This  is  accomplished  by 
making  the  disk  in  pieces,  as  a  series  of  concentric  rings.  Lifting  off  rings  in  succession 
causes  significant  and  profound  changes  to  occur  abruptly  in  the  dynamics  of  the  system, 
providing  a  severe  test  for  any  adaptive  controller. 

Moreover,  experience  has  shown  that  lightly-damped  mechanical  systems  pose  a  diffi¬ 
cult  problem  even  for  offline  techniques  —  let  alone  online  ones  —  when  small  measurement 
noise  exists.  These  problems  include  excessive  computation,  parameter  bias  (a  euphemism) 
and  convergence  to  local  minima. 


Three  Approaches 

We  have  carried  forward  three  different  approaches  to  achieving  experimental  adaptive 
control  of  the  challenging  mechanical  laboratory  system  that  we  built  for  this  purpose. 

The  adaptive  control  system  developed  first,  historically — a  natural  frequency-detection 
based  approach  by  Wen  Wie  Chiang  using  a  using  a  frequency-locked  loop — is  reported 
last  in  this  section,  as  Approach  3.  This  work  is  now  complete,  and  has  been  reported  in 
the  literature  [Chi  T].  Two  more  recent  projects  (Approaches  1  and  2)  are  based  on  making 


Fig.  3d.-l  Laboratory  Four-Disk  System 

The  system  consists  of  four  steel  disks  connected  by  a  long  steel  rod.  There  is 
a  brushless  DC  motor  on  the  third  disk,  and  an  angular  sensor  on  the  lowest 
disk.  The  system  has  three  vibration  modes  and  a  rigid  body  mode. 


a  polynomial  best-fit  to  the  system’s  transfer  function  in  real  time.  These  are  reported 
first.  They  both  are  still  under  way,  and  provide  a  head  start  into  new  research  under  a 
new  AFOSR-supported  program  at  Stanford. 

In  Approaches  1  and  2,  the  basic  algorithm  form  we  have  studied  is  the  Self-Tuning- 
Regulator,  which  consists  of  an  on-line  identification  scheme  for  measuring  system  param¬ 
eters  and  a  pole-placement  algorithm  for  modifying  the  controller  based  on  the  identified 
parameters.  We  have  taken  two  approaches  to  the  identification  problem.  In  the  one 
approach,  (Approach  2)  the  transfer  function  of  the  system  is  regarded  as  (almost)  com¬ 
pletely  unknown,  a  priori.  A  recursive  least-squares  calculation  is  used  to  fit  a  system 
transfer  function  to  data  measured  during  controller  operation.  The  other  approach  (Ap¬ 
proach  1)  regards  the  system  transfer  function  as  being  completely  known  except  for  the 
inertias  of  the  two  aforementioned  discs,  which  are  regarded  as  being  free  to  take  on  a 
continuum  of  values.  The  latter  technique  may  have  advantages  in  robustness  and  speed 
of  convergence,  since  it  involves  less  uncertainty  about  the  physical  system.  However,  the 
identification  algorithm  involves  an  algebraically  non-linear  gradient  search,  which  is  more 
computationally  intensive  than  a  linear  least-squares  fit. 

In  all  three  approaches  the  primary  goal  has  been  to  demonstrate  an  adaptive  control 
system  that  works  on  a  mechanical,  highly  challenging  experimental  system,  namely  the 
four  disk  system  of  Fig.  3d.-l  especially  constructed  by  Rosenthal  [Ros  T].  This  system  was 
chosen  for  two  reasons,  first  because  it  is  highly  linear  and  very  well  modeled  analytically, 
and  second  because  it  is  designed  to  enable  abrupt  large  changes  in  a  critical  system 
parameter  to  be  made  readily. 

Rosenthal  performed  experiments  on  this  system  to  demonstrate  the  performance  of 
robust  controllers  designed  using  parameter  optimization  techniques.  His  results  showed 
that  the  best  possible  robust  (but  non-adaptive)  contollers  that  could  stabilize  the  plant  for 
all  available  values  of  the  adjustable  parameter  had,  in  general,  poor  performance,  in  that 
their  closed-loop  damping  was  just  as  low  as  for  the  uncontrolled  system  (about  0.1%  in 
our  experimental  apparatus).  The  objective  of  applying  adaptive  control  techniques  to  this 
system  is  to  demonstrate  performance  much  superior  to  that  achievable  with  the  best  robust 
controller,  and  more  broadly  to  gain  generic  experience  in  applying  adaptive  controllers  to 
mechanical  systems  with  structural  flexibility. 

Design  Criteria 

There  are  two  major  demands  made  on  an  adaptive  controller  by  the  four  disk  system. 
The  first  is  the  requirement  that  the  controller  be  able  to  adapt  to  a  step  change  in  the 
inertia  of  one  of  the  system  disks.  An  adaptive  controller  that  is  able  only  to  adapt  to 
gradually  varying  system  parameters  will  not  be  satisfactory.  The  second  major  demand 
is  closely  related  to  the  first.  The  locations  of  a  pole  and  zero  on  the  imaginary  axis  of  the 
system’s  s-plane  diagram  ‘flip’  when  the  inertia  of  the  top  disc  is  changed.  Any  control 
law  giving  good  performance  is  almost  sure  to  be  destabilized  by  this  phenomenon,  with 
a  relatively  short  time  constant.  Hence  the  adaptive  controller  must  be  able  to  respond 
quickly  to  parameter  changes. 

The  self-tuning  regulator  type  of  adaptive  controller  was  chosen  for  implementation, 


as  it  was  hoped  that  it  would  be  able  to  meet  these  demands  on  its  performance.  Such  a 
controller  performs  two  distinct  tasks.  First,  it  implements  an  algorithm  to  identify  the 
plant  transfer  function.  Second,  it  calculates  a  control  law  to  locate  the  closed-loop  poles 
of  the  system  in  pre-specified  locations  using  the  identified  plant  transfer  function. 

APPROACH  1:  Reduced- Order  Identification  Algorithm 

The  controller  implemented  here  differs  from  those  described  in  the  literature.  Most 
notably,  a  technique  for  using  the  highly  structured  nature  of  the  plant  uncertainty  to 
speed  up  the  identification  process  was  devised. 

The  purpose  of  the  identification  algorithm  is  to  calculate  a  transfer  function  to  fit 
the  measured  values  of  plant  input  and  output.  The  pole  placement  algorithm  (that  is,  the 
control  law  calculation)  requires  that  the  open  loop  plant  transfer  function  be  calculated. 
This  is  what  the  following  algorithm  does. 

As  noted,  it  is  critical  that  the  identification  algorithm  be  speedy  for  the  four  disk 
system.  However,  the  four  disk  system  is  of  eighth  order,  so  that  the  transfer  function 
contains  sixteen  unknowns,  the  eight  coefficients  of  the  numerator  and  denominator  poly¬ 
nomials.  In  the  absence  of  noise  then,  at  least  sixteen  pieces  of  data  are  required  after 
a  step  change  in  a  system  parameter  has  occurred  before  a  new  transfer  function  can  be 
identified,  if  the  system  is  treated  as  wholly  unknown.  In  the  case  of  the  four  disk  system, 
however,  only  one  parameter  is  subject  to  change.  This  points  up  the  possibility  of  making 
use  of  knowledge  of  the  plant  to  be  controlled  to  speed  identification.  The  problem  is  to 
make  use  of  this  knowledge  in  a  way  that  can  be  implemented  in  real  time. 


Description 

The  basis  of  the  algorithm  is  one  of  the  standard  techniques  of  linear,  discrete-time 
identification,  which  is  based  on  the  following  fact:  The  coefficients  of  the  transfer  function 
polynomials,  b(z)  in  the  numerator  and  a(z)  in  the  denominator,  can  be  used  directly  to 
form  a  difference  equation  satisfied  by  the  samples  of  the  plant  input  and  output.  That  is, 
if  the  plant  transfer  function  is  modeled  as 


B{z)  = 


bjZ n~l  -l - h  6„ 

a"  -f  axzn-1  -t - h  On 


(1) 


then  we  can  immediately  write: 


y(k)  =  -aty(k  -  1) 


a„y(k  -n)  +  btu(k  -  1)  H - +  bnu(k  -  n). 


(2) 


as  the  difference  equation  corresponding  to  this  transfer  function,  where  y(k)  and  u(k)  are 
the  plant  output  and  input  at  the  kth  time  step.  For  identification  purposes,  the  model 
difference  equation  is  used  to  predict  the  value  of  y(k)  given  past  values  of  plant  outputs 
and  inputs.  The  presence  of  disturbances  and  unmodeled  dynamics  causes  the  predicted 
value  to  differ  from  the  actual  measured  value,  and  an  error  is  formed  which  indicates  how 


well  a  given  guess  of  the  plant  transfer  function  matches  the  true  system  behavior.  The 
error  is  defined  by: 

e{k)  =  y{k)  -  {-aty{k  -  1) - any(k  -  n)  +  6iu(fc  -  1)  +  •  •  •  +  b„u(k  -  »)}  (3) 

This  is  known  as  the  equation  or  prediction  error.  In  the  standard  linear  least  squares 
algorithm,  the  transfer  function  coefficients  that  minimize  a  scalar  performance  index 
J  =  e(k)2  are  found  using  a  recursive  calculation. 

The  present  algorithm  is  slightly  more  complicated.  It  uses  the  same  error  criterion, 
but  considers  each  transfer  function  coefficient  to  be  a  function  of  one  or  two  unknowns, 
say  a„  =  /„( x,  y)  and  6n  =  gn(x,y)  where  x  and  y  are  the  inertias  of  two  of  the  four  disks. 
The  function  /„  (or  gn)  is  implicitly  defined  by  the  equations  of  motion  of  the  system,  and 
is  very  complicated.  Having  done  this,  the  performance  index  J  becomes  a  function  of 
only  two  variables,  x  and  y,  rather  than  of  all  the  o„*8  and  6„’s.  Therefore  ideally  only 
two  pieces  of  information  are  needed  to  find  the  best  fit  transfer  function,  since  there  are 
only  two  degrees  of  freedom  in  J.  (Note  that  when  the  values  of  x  and  y  that  minimize  J 
are  determined,  the  transfer  function  coefficients  are  determined  from  the  equations  like 
On  =  /»(*,  y)0 

There  are  two  obvious  drawbacks  to  this  approach.  First,  as  mentioned,  the  functions 
/„,  gn  ore  generally  very  complicated.  This  difficulty  is  overcome  by  approximating  them 
with  polynomials.  This  can  be  accomplished  numerically  by  a  simple  procedure  to  be 
described.  Second,  the  problem  of  minimizing  the  performance  index  J  no  longer  reduces 
to  the  solution  of  a  set  of  linear  equations.  This  too  must  be  done  numerically,  using  a 
gradient  search  algorithm  which  will  also  be  described  in  detail.  For  a  small  number  of 
independent  variables  the  minimization  can  be  accomplished  in  real  time. 

The  final  issue  which  must  be  addressed  is  the  means  of  handling  step  changes  in 
parameters,  and  the  closely-related  problem  of  switching  off  the  identification  algorithm 
when  plant  input  is  too  small  to  dominate  the  effects  of  noise. 

First  something  needs  to  be  said  about  recursive  versus  batch  identification.  As  al¬ 
ready  mentioned,  the  algorithms  in  the  literature  are  usually  recursive.  Each  new  value 
of  e(k),  along  with  all  or  most  of  the  previously-measured  values,  is  used  to  improve  the 
estimate  of  the  transfer  function  coefficients.  This  obviously  helps  alleviate  the  effects  of 
noise  in  the  measurements;  but  it  is  difficult  to  make  such  an  algorithm  respond  quickly  to 
step  parameter  changes.  In  contrast,  it  is  hoped  that  reducing  the  number  of  unknowns  to 
identify  will  provide  enough  robustness  to  noise  so  that  a  calculation  using  a  small  batch 
of  data  can  be  made.  That  is,  a  performance  index  is  defined  for  each  time  step  which 
sums  N  immediately-preceding  values  of  e(k)2  where  N  is  fixed.  For  each  time  step  a  new 
(albeit  overlapping)  “batch”  of  data  is  used  to  form  J,  and  a  new  pair  of  values  (x,y)  is 
calculated. 

When  a  step  parameter  change  occurs,  for  n  time  steps  (where  n  is  the  order  of  the 
plant)  it  is  no  longer  valid  to  write  Equation  2.  This  is  because  Equation  2  is  derived  under 
an  assumption  of  time  invariance  for  at  least  n  time  steps.  This  limits  the  speed  with  which 
any  identification  algorithm  based  on  a  high  order  difference  equation  can  adapt  to  a  step 
parameter  change.  However,  because  of  the  batch  nature  of  this  identification  algorithm, 


adaptation  can  occur  n  +  N  steps  after  the  abrupt  change,  where  N  is  chosen  to  alleviate 
noise  problems  and  is  at  least  two  (for  two  unknowns). 

Clearly  it  is  desirable  for  the  identification  algorithm  to  detect  the  time  step  at  which 
the  abrupt  change  occurs,  since  this  essentially  invalidates  all  the  previous  data,  as  well 
as  the  succeeding  n  data  points.  The  identification  calculation  must  be  turned  off  until 
Equation  2  is  again  valid.  A  good  method  for  doing  this  has  not  yet  been  determined. 

The  identification  algorithm  should  also  be  turned  off  when  the  signal-to-noise  ratio 
in  the  data  drops  too  low. 

Derivation  of  Algorithm 

Detailed  equations  for  the  application  of  this  identification  algorithm  to  the  four  disk 
system  are  now  given. 

Calculation  of  /*’ s 

The  calculation  of  the  /„’ s  starts  with  the  system  equations  in  state  space  form.  For 
each  disc,  let  0,-  be  the  angular  displacement,  and  u,  be  the  corresponding  angular  velocity. 
Let  k  be  the  spring  stiffness  constant.  Let  J  be  the  nominal  inertia  of  each  disk.  Numbering 
discs  from  the  top,  the  first  and  third  have  variable  inertias,  define  z  and  y  by  the  relations 
Ji  =  J/x  and  Js  =  J/y.  Let  oj2  =  k/J.  Let  T  be  the  motor  torque,  and  let  u  =  T/J.  The 
system  equations  for  any  value  of  z  and  y  are: 

0  1  0  0  0  0  0  01  fo' 

-w*z  0  u20x  0  0  0  0  0  0 

0001  0000  0 
w  l  0  -2  ul  0  ul  0  0  0,1 

0  0  0  0  0  1  0  0  +  0  tt 

0  0  u\y  0  -2w2y  0  u\y  0  0 

00000001  0 
0  0  0  0  w?  0  -w?  0  0 

9  v  J 

These  equations  can  also  be  written  as  x  =  Fx  +  Gu.  The  next  step  is  to  calculate  a 
set  of  discrete  equivalent  system  equations  in  the  form  x(fc  +  1)  =  ftx(fc)  +  Txi(k).  Since 
this  is  done  numerically,  values  must  be  assigned  to  all  constants,  including  z  and  y,  and 
a  sampling  period  must  be  chosen.  A  set  of  values  for  z  and  y  was  chosen  as  follows, 
z  €  (.2(1  +  j)}  for  j  —  1, . . . ,  24  and  y  €  {.2(1  +  k)}  for  k  =  1, . . . ,  12.  A  typical  sampling 
period  is  .1  seconds.  The  value  of  w2  is  about  185  sec-2.  To  improve  numerical  accuracy, 
the  equations  are  scaled  by  measuring  time  in  units  of  tenths  of  seconds.  As  an  example 
calculation,  for  z  =  y  =  1.0,  the  following  are  obtained: 
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Altogether  24  x  12  =  288  discrete  equivalents  were  calculated,  one  for  each  pair  of  values 
(x„  y,).  Next  the  discrete  state  space  equations  were  converted  to  transfer  functions,  using 
the  equation  H[z)  =  h(xl  -  9)-1r.  The  measurement  matrix  is 

h  =  [0  0  0  0  0  0  1  0). 

As  an  example,  for  the  same  values  of  x  and  y  as  above, 

0.0033 jt  +  0.12852*  +  0.46592s  +  0.36752*  +  0.36752s  +  0.46592*  +  0.12852  +  0.0033 
~  2*  -  1.15702*  +  0.88682*  -  1.41262s  +  1.36562*  -  1.41262s  +  0.88682*  -  1.15702  +  1.0' 

It  is  a  useful  simplification  to  note  that  6t  =  bt,  b2  =  67,  etc.  Now  the  polynomial 
approximations  which  give  the  a„’s  and  6„’s  as  functions  of  x  and  y  are  calculated  using 
standard  linear  least-squares  regression  and  the  normal  equations.  The  order  of  the  fit 
(which  is  the  same  for  all  the  coefficients)  was  chosen  by  trial  and  error,  by  simply  increasing 
the  order  until  the  errors  were  acceptable.  I  now  give  the  details  of  the  calculation  for  an 
example,  63.  Define  a  vector  Y  of  function  values 

Y  =  [6s(x1,yi),63(x2,  Vi)t  •  •  •  >  ^a(*X4»  Sh )>  &s(*i»  lk)»  •  •  • » &s(*24>  Ste))7". 

Next  define  a  vector  9  of  the  coefficients  of  the  least  square  fit  polynomial  y3: 


® —  [cl»  ^2»  •  •  •  »  Cl#]  . 

This  is  for  a  polynomial  which  is  fourth  order  in  both  x  and  y  as  follows: 

y3(x,  y)  =  Ci  +  cax  +  c3y  +  c«x2  +  c6y2  +  c«xy  +  c7x*  +  c8y*  +  c#x2y 

+  ci0xy2  +  CnX*  +  cl2y4  +  cisxsy  +  c14x2y2  +  cx5xys 

Now  define  a  matrix  #  of  values  of  x,-,  y x2,  etc.  so  the  the  product  *0  will  give  a  vector 
of  values  of  the  fit  to  63(x,  y) 
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These  quantities  satisfy  an  equation  of  the  form  Y  =  99  +  e(9)  where  e  is  a  vector  of 
errors.  Setting  0  =  (9r9)_i9rY  minimises  .7(0)  =  ere.  In  the  case  of  6S,  the  vector  0 
is 


0  =  [-0.0096, 0.014r,  0.4412,  -0.0058,  -0.1703,0.2336,0.0009,0.0225, 

-0.0267,  -0.0378, 0.0001,  -0.0013, 0.0008, 0.0029, 0.0016] 


The  same  procedure  gives  a  polynomial  approximation  to  each  of  the  transfer  function 
coefficients. 


Gradient  Search  Routine 
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In  this  section  the  equations  used  to  find  the  values  of  x  and  y  which  best  fit  the 
measured  plant  inputs  and  outputs  are  derived.  As  already  explained,  this  is  done  by  min¬ 
imising  numerically  a  performance  index  based  on  the  equation  error.  Put  the  equations 
of  the  earlier  section  in  matrix  form.  First  define  a  vector  Y  of  plant  outputs: 


Y=  [»(*),»(*- 1) . 


Here  If  is  the  number  of  time  steps  in  the  batch.  Next  define  a  row  vector  of  plant  outputs 
and  inputs 


lH»)  =  (y(»  -  1), y(n  -  2), . . . ,  y(n  -  N),  u(n  -  1),  u(»  -  2), . . . ,  u(n  -  N )] . 
Here  n  refers  to  the  nth  time  step.  Now  define  a  matrix  ®  whose  nth  row  is 


»  = 


*(*) 

*(*  "  1) 


ll>(k-N+  1)J 


I  now  define  a  matrix  P  and  a  vector  V  such  that  the  product  PV  (where  V  =  V(x,y)) 
is  a  vector  of  transfer  function  coefficients  for  some  pair  of  values  (x,y).  This  uses  the 
definitions  of  the  /„’ s  given  earlier.  Let 


V  =  [l,x,y,xa,yalxy,...,xy5]. 


Let 
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Here  the  cj  are  the  j  coefficients  of  the  polynomial  approximation  to  a,-  =  /,(x,  y)  or 
bi  =  y,(x,  y).  It  is  easily  verified  that: 


PV  —  [  alf  iij, . . . ,  a8, bit 62, . . . , b$)  . 


Comparison  with  Equation  3  shows  that  E  =  Y  —  ®PV  where  E  is  a  vector  of  equation 
errors: 

ir 


E  =  (e(*),e(*-1) . e(*-J\r+l)]] 

Finally,  the  performance  index  to  be  minimised  is  simply  J  =  l/2(ErE).  Unfortunately, 
J  is  not  quadratic  in  z  and  y,  so  that  minimising  J  is  a  nonlinear  problem.  A  numerical 
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algorithm  is  used  to  find  the  pair  of  values  (x,y)  which  minimize  J.  This  algorithm  can 
be  easily  switched  between  a  second  order  Newton-Raphson  method  and  a  first  order 
gradient  search.  The  algorithm  requires  that  the  first  and  second  partial  derivatives  of 
J  with  respect  to  x  and  y  be  available.  Because  polynomial  approximations  to  the  a„’s 
and  6„’s  were  chosen,  these  derivatives  are  easy  to  calculate  analytically.  In  fact,  all  the 
dependence  on  z’s  and  y’s  is  in  the  V  vector.  Therefore: 

J  =  h Y  -  #PV)r(Y  -  ®PV) 

~  =  (Y  -  ®PV)r(-®PVa) 
ox 

=  (Y  -  ®PV)r(-»PVr) 

d2J 

=  (Y  -  *PV)r(-»PV„)  +  (»PV,)r(®PV,) 

d2  J 

fjr  =  (Y  -  ®PV)r(-»PV„)  +  (®pv,)r(»pv,) 


dxdy 


=  (Y  -  ®PV)r(-»PV„)  +  (®PV,)r(®PVr) 


Here  V,  is  used  for  d  V /dx,  etc.  Calculating  these  derivatives  of  V  is  trivial,  for  example, 
V,  =  [o,  1, 0, 2x,  0,  y,  3x2, 0, 2xy,  y2, 4xa,  0, 3x2y,  2zy2,  ys] T . 

The  algorithm  uses  the  Hessian  matrix  H(z,  y)  defined  as: 

t'l- 

Given  a  guess  of  z  and  y,  the  formula  giving  the  new  values  which  hopefully  improve  the 
performance  index  J  is: 


i-ci-fe  fcfm- 


In  the  control  program,  the  size  of  a  is  adjusted  until  an  improvement  in  J  occurs.  Also, 
H(z,  y)  is  tested  for  positive-definiteness,  if  the  test  is  not  satisfied  an  increment  is  added 
to  the  diagonal  of  H  until  it  is  just  barely  positive  definite.  This  effectively  changes  the 
algorithm  from  second  order  Newton-Raphson  to  a  first  order  gradient  search.  Given 
sufficient  computer  speed,  a  good  approximation  to  the  values  of  z  and  y  which  minimize 
J  can  be  made  during  each  time  step.  Finally,  these  identified  values  of  z  and  y  are  plugged 
back  into  the  Y  vector  and  the  product  PV  is  formed.  This  product  gives  the  identified 
transfer  function  coefficients  in  the  form  of  a  column  vector  ready  for  input  to  the  control 
law  algorithm. 


Control  Law  Calculation 

The  control  law  algorithm  basically  computes  the  transfer  function  of  a  compensator 
that  will  locate  the  closed  loop  system  poles  in  predefined  locations.  It  is  an  unfortunate 
fact  that  such  an  approach  requires  the  use  of  a  compensator  of  order  at  least  n  —  1,  where 
n  is  the  order  of  the  plant.  However,  the  logic  and  implementation  of  the  algorithm  are 
simple,  which  is  what  makes  it  an  attractive  method. 

As  earlier,  denote  the  discrete  plant  transfer  function  (which  is  calculated  by  the 
identification  algorithm  already  described  by  H{z)  =  6(z)/a(z).  The  compensator  transfer 
function  is  assigned  the  form: 


u(z) 


”>(*) 

/(*) 


(4) 


Here  r(z)  is  the  command  input,  and  m,  /,  and  p  are  polynomials  in  z.  Note  that  the 
compensator  has  two  inputs,  the  plant  output  y(z)  and  the  command  input,  and  one 
output,  the  control  signal  u(z).  As  noted  in  the  discussion  of  Equation  1,  once  such  a 
transfer  function  is  known,  it  can  be  converted  immediately  into  a  difference  equation  for 
u(fc).  This  is  the  approach  taken  in  the  control  program. 

Given  a  compensator  transfer  function  of  the  form  (4),  some  simple  calculations  show 
that  the  overall  transfer  function  from  r  to  y  of  the  closed  loop  system  has  a  characteristic 
polynomial  a*(z)  given  by: 


a*(z)  =  /(z)a(z)  +  p(z)6(z). 


(5) 


This  equation  is  sufficient  to  determine  the  polynomials  /(z)  and  p(z)  from  the  identified 
plant  polynomials  a(z)  and  b(z)  and  the  desired  closed  loop  characteristic  polynomial 
a*(z).  There  is  a  small  amount  of  latitude  in  choosing  the  desired  order  of  a*,  p  and  l, 
corresponding  to  a  choice  of  a  predictor,  current,  or  Gopinath  compensator.  The  choice 
of  a  current  compensator  makes  a*  16th  order,  /  8th  order,  and  p  7th  order  (for  the  8th 
order  four  disc  system).  Specifically, 


a*(z)  =  1  +  a\z~l  H - +  oJ#z_u 

l(z)  =  1  +  fiz-1  H - 1-  f|Z-# 

P(z)  =  p0  +  ptz~l  +  ■■■+  p7z~7 


The  control  program  reformulates  Equation  5  as  a  17th  order  system  of  linear  algebraic 
equations  in  the  coefficients  of  l  and  p  which  is  then  solved  by  Gaussian  elimination.  This 


is  done  by  equating  like  powers  of  z  and  results  in  the  following  system: 
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In  the  control  program,  the  solution  vector  to  this  equation  is  substituted  directly  into 
a  difference  equation  formed  from  Equation  4  which  results  in  the  control  signal.  The 
polynomial  m(z)  is  calculated  in  advance  (except  for  a  D.C.  gain)  and  affects  only  the 
overall  zeros  of  the  closed  loop  system,  m  is  chosen  so  that  it  cancels  eight  of  the  poles 
of  the  closed  loop  system,  and  a  D.C.  gain  for  m  is  calculated  based  on  the  results  of  the 
identification  such  that  the  D.C.  gain  of  the  closed  loop  system  is  unity. 

Experimental  Results 

To  date  only  the  identification  algorithm  has  been  tested  experimentally,  due  to  dif¬ 
ficulties  encountered  with  its  performance.  Many  experimental  tests  of  the  identification 
algorithm  have  been  made  using  fixed-gain  controllers  to  operate  the  plant.  To  simplify 
testing,  only  one  parameter,  the  inertia  of  the  top  disk,  has  been  estimated.  Several  sam¬ 
pling  rates  have  been  utilized,  and  the  effect  of  sampling  rate  on  identification  performance 
has  been  studied. 

Figure  3d.-2  displays  the  data  from  a  typical  experiment  in  which  a  10  Hz  sampling 
rate  was  used.  Both  rings  were  in  place  on  the  top  disk  during  this  experiment.  Figure 
3d.-2  is  a  plot  of  the  plant  output  (angular  position  of  the  bottom  disk  in  radians)  versus 
time  in  seconds.  Figure  3d.-2  shows  the  command  input  which  generated  this  output,  a  2.7 
Hz  sine  wave.  Figure  3d.-2  is  a  plot  of  the  estimate  of  the  inertia  of  the  top  disk  divided 
into  the  nominal  value  of  inertia  with  both  rings  in  place.  As  can  be  seen,  the  estimate 
is  quite  good  for  this  combination  of  sampling  rate  and  command  input,  showing  that  the 
identification  algorithm  is  working  properly.  The  ‘batch’  size  is  10  samples.  Figure  3d.-2 
shows  the  input  signal  to  the  torque  motor. 

Figure  3d.-3  displays  the  data  from  a  similar  experiment  in  which  a  20  Hz  sampling 
rate  was  used.  Again  both  rings  were  in  place,  the  command  input  is  a  2.7  Hz  sine  wave, 
and  the  batch  size  is  10  samples.  The  closed  loop  poles  of  the  fixed  gain  controller  used 
for  this  experiment  correspond  to  those  used  in  the  experiment  of  Figure  2  under  the 
mapping  d  —  zA  where  s'  is  the  pole  location  for  20  Hz  sampling  rate.  It  is  notable  that 
the  parameter  estimate  is  very  poor  compared  to  the  10  Hz  sample  rate  case. 

After  a  long  investigation,  the  source  of  difficulty  was  determined.  Figure  3d.-4  is  a 
plot  of  a  section  of  the  plant  output  sequence  for  two  successive  runs  of  the  experiment.  As 


can  be  seen,  repeatability  of  the  experimentally  measured  plant  output,  while  extremely 
good,  is  not  perfect.  The  differences  plotted  are  never  more  than  two  bits  of  resolution 
of  the  A/D  converter,  representing  about  4%  of  the  output  swing  for  this  particular  ex¬ 
periment.  Also  plotted  are  the  predicted  values  of  the  plant  output  for  the  ninth  sample 
calculated  from  the  first  eight  experimental  output  values  for  each  of  the  two  runs,  using 
difference  equation  coefficient  values  corresponding  to  the  actual  value  of  the  top  disk  iner¬ 
tia.  Clearly  the  predicted  values  are  quite  different,  despite  the  almost  identical  values  of 
the  plant  output  on  which  the  predictions  are  based.  (The  effect  of  the  past  inputs  on  the 
prediction  can  be  calculated  separately  and  are  negligible  in  the  present  instance.)  Thus  it 
is  seen  that  the  predictor  Equation  2  has  the  pathological  property  (for  the  case  of  20  Hz 
sampling  rate)  that  tiny  perturbations  in  the  values  of  the  past  plant  outputs  y(k)  cause 
large  variations  in  the  value  of  the  prediction.  It  is  this  property  which  results  in  the  very 
poor  performance  of  the  identification  algorithm  illustrated  in  Figure  3d.-3. 

A  clue  as  to  the  source  of  the  problem  is  seen  in  Table  3d.-l,  which  lists  the  coefficients 
of  the  predictor  equation  for  the  case  of  nominal  (both  rings  in  place)  top  disk  inertia  and 
both  sampling  rates.  Both  sampling  rates  result  in  coefficients  which  alternate  in  sign,  but 
those  of  the  equation  corresponding  to  20  Hz  sampling  are  almost  100  times  larger. 

Some  additional  insight  can  be  gained  by  examining  the  frequency  response  of  the 
operator  o(z).  Figure  3d.-5  shows  a  plot  of  the  magnitude  of  a(e*uT)  versus  frequency  for 
both  values  of  sampling  rate.  Largely  because  of  the  increased  Nyquist  frequency  for  the 
20  Hz  sampling  rate,  the  maximum  gain  of  the  operator  a(z)  is  increased  by  a  factor  of 
about  15  compared  to  the  maximum  gain  for  10  Hz  sampling.  (This  is  not  a  suprising 
fact,  if  the  operator  1  /a(z)  had  been  plotted  instead,  the  bode  plot  would  have  shown  the 
usual  high  frequency  roll-off  of  a  4-pole  transfer  function.  The  higher  Nyquist  frequency 
merely  allows  for  more  roll-off  before  aliasing  begins.)  To  see  the  effect  that  such  a  large 
high  frequency  gain  might  have  on  the  identification  process,  consider  an  approximate 
frequency  domain  expression  for  the  identification  performance  index  J :* 

«)l’. 

L  k=l 

Here  N  is  the  number  of  samples,  G  is  the  ratio  of  the  periodogram  of  the  output  sequence 
y(ojk)  to  the  periodogram  of  the  input  sequence  u (u/*),  (termed  by  Ljung  the  ‘empirical 
transfer  function  estimate’)  and  G(z,  9)  is  the  estimated  transfer  function  depending  on  the 
parameter  vector  9,  G(z,9)  =  b(z,0)/a(z,9).  The  error  in  the  approximation  decays  like 
l/y/N  and  also  depends  on  the  rate  of  decay  of  the  impulse  response  of  the  plant,  which  is 
slow  for  the  lightly  damped  system  under  consideration.  Nevertheless,  at  least  a  qualitative 
understanding  of  the  problems  encountered  with  the  identification  algorithm  can  be  gained 
from  this  formula.  The  very  large  high  frequency  gain  of  the  analytically  calculated  a(w) 

would  tend  to  give  heavy  emphasis  to  fitting  G  to  Cl  in  the  highest  frequency  regions,  where 
G  is  dominated  by  noise.  Consequently,  the  algorithm  does  not  estimate  a(u>)  properly,  in 
fact  it  tends  to  calculate  an  a(w)  which  does  not  roll  off  as  fast  at  high  frequencies  as  the 
analytically  predicted  a. 

*  Ljung,  Lennart,  Syrtem  Identification .  Theory  for  the  Uier,  1084,  Unpublitked  Afannicript. 
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ample  No 


20  Hz  Denominator  Coefficients 


aO 

1.0000 

al 

-5.4953 

a2 

14.7515 

a3 

-25.2328 

a4 

29.9535 

a5 

-25.2328 

a6 

14.7515 

a7 

-5.4953 

a8 

1.0000 

10  Hz  Denominator 

Coefficients 

aO 

1.0000 

al 

-0.6951 

a2 

0.1899 

a3 

-0 . 8008 

a4 

0.6337 

a5 

-0 . 8008 

a6 

0.1899 

a7 

-0.6951 

a8 

1.0000 

Table  3d.-l  Transfer  Function  Coefficients 
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These  considerations  also  suggest  a  solution  to  the  problem,  which  is  to  filter  the  pre¬ 
diction  error  sequence  (which  is  equivalent  to  filtering  the  input  output  data  {y{k)  «(£)}) 
through  a  low-pass  filter.  (This  approach  was  also  suggested  by  Sidman.  See  Approach  2 
below.)  The  integrand  in  the  above  expression  is  then  multiplied  by  the  magnitude  squared 

of  the  filter  transfer  function,  say  \L(e>u)\  .  The  effects  of  high  frequency  noise  in  G  can 
thus  be  mitigated  to  an  extent. 

Figure  3d.-6  illustrates  the  effect  of  a  fourth  order  butterworth  filter  on  the  perfor¬ 
mance  of  the  identification  algorithm  for  the  same  data  as  in  Figure  3d.-3.  A  dramatic 
improvement  is  seen. 

The  effects  discussed  are  not  peculiar  to  the  identification  algorithm  described,  which 
uses  a  reduced-order  parameterization  of  the  trial  transfer  functions.  They  are  instead 
related  to  the  choice  of  performance  index  minimized  by  the  identification  algorithm.  A 
different  choice  of  performance  index  might  give  better  performance. 


APPROACH  2:  Fall- Order  Representation 

What  is  needed  is  a  technique  or  combination  of  techniques  that  reliably  lead  to  unbi¬ 
ased,  accurate  plant  parameter  estimates  in  a  relatively  small  number  of  sample  intervals. 
This  methodology  should  be  insensitive  to  bias  forces  in  the  actuator  and  sensor  offsets 
as  well  as  measurement  noise  generated  in  the  A/D  conversion  process  itself.  Lastly,  this 
method  should  not  require  excessive  computation  and  should  be  insensitive  to  unmodeled 
dynamics  if  it  is  to  find  practical  application.  Admittedly,  this  is  an  ambitious  list,  but 
one  that  is  not  impossible  to  satisfy  with  some  minor  compromise.  The  essence  of  this 
compromise  is  to  make  limited  use  of  known  information  about  the  plant  to  be  controlled. 

One  set  of  information  required  to  guarantee  accurate,  fast  and  reliable  parameter 
estimation  of  lightly-damped  mechanical  plants  is  the  nature  of  disturbances  in  the  control 
system.  Because  the  identification  method  pursued  here  is  targeted  to  feedback  control 
systems,  the  assumed  disturbances  take  the  form  of  broadband  measurement  noise,  dc 
and  low-frequency  bias  forces,  position-sensor  offset  and  high-frequency  unmodeled  plant 
dynamics. 

In  essence,  the  problem  is  evolved  here  into  making  use  of  limited  information  about 
the  plant  without  knowing  the  frequencies  of  resonances  and  antiresonances  and  how  they 
might  interact  with  each  other  for  a  given  physical  plant.  In  so  doing,  it  has  been  possible 
to  reduce  the  number  of  parameters  required  to  identify  the  plant  by  approximately  a 
factor  of  four,  even  though  the  plant  dynamics  are  fully  represented.  The  accuracy  of 
the  identification  has  also  improved  dramatically,  even  for  relatively  short  sets  of  plant 
input/output  data  that  constitute  training  sequences. 

An  ARMAX  (Auto- regressive  Moving  Average  with  Exogenous  input)  model  of  the 
plant  is  assumed.  In  the  case  of  the  Four- Disk  System  (Fig.  3d.-l),  the  ARMA  portion  of 
the  model  is  described  with  sixteen  parameters,  which  also  represent  the  eight  coefficients 
of  the  characteristic  equation  and  the  eight  coefficients  of  the  numerator  polynomial  of  the 
plant’s  discrete-time  transfer  function. 

The  process  for  identifying  this  type  of  plant  is  really  a  combination  of  techniques 
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each  of  which  independently  can  be  shown  to  improve  the  quality  of  identification,  but 
which  together  act  in  a  complementary  manner. 

The  final  algorithm  has  been  successfully  demonstrated  in  real-time  on  the  Mechanical 
Four-Disk  System.  However,  learning  what  either  doesn’t  work  well  or  isn’t  practical  is 
probably  as  important  as  what  appears  now  to  be  an  effective  means  of  on-line  identification 
for  adaptive  control. 


Summary  of  Major  Results:  FWRLS  Identification: 

Identifying  all  sixteen  of  the  Four-Disk  System’s  ARMA  parameters  in  the  presence 
of  minute  amounts  of  measurement  noise  results  in  poor  identification  of  the  plant  zeroes 
that  lie  along  the  negative  real  axis  in  the  Z  plane.  Since  the  true  locations  of  these 
zeroes,  which  come  in  from  infinity  in  the  continuous  domain,  are  quite  insensitive  to  plant 
variation  caused  by  important  types  of  plant  variation  such  as  change  in  inertia,  they  can 
be  assumed  known  a  priori  and  removed  from  the  identification  problem.  In  fact  these 
zeroes  play  a  minor  role  in  the  time  response  of  the  plant  other  than  delay.  Likewise,  the 
poles  corresponding  to  the  rigid  body  modes  are  invariant  to  such  types  of  plant  variation 
and  should  be  removed  from  the  identification  problem. 

The  FWRLS  method  developed  by  Clary  makes  use  of  the  known  plant  poles  and 
zeroes  and  reduces  the  number  of  parameters  to  be  identified  substantially.  Pursuing 
fewer  parameters  result  in  faster  convergence  and  greatly  reduced  computational  loads. 
The  Four-Disk  System,  which  is  an  eighth-order  system,  could  now  be  reduced  to  a  nine- 
parameter  identification  problem  using  this  method.  Since  the  computational  burden 
associated  with  identification  is  a  geometric  function  of  the  number  of  parameters  to  be 
estimated,  a  factor  of  two  reduction  in  the  number  of  parameters  by  this  method  resulted 
in  about  a  factor  of  four  reduction  in  computation  time. 


The  Problem  with  Broadband  Measurement  Noise: 

Measurement  noise  arising  from  A/D  quantization  and  sensors  will  ‘bias’  the  param¬ 
eter  estimates  substantially  in  batch  or  recursive  least  squares  (LS)  identification. 

This  happens  because  even  white  measurement  noise  becomes  colored  equation  error 
in  the  least-squares  problem  formulation.  “Colored”  is  a  euphemism  for  many  problems 
where  the  number  of  poles  of  the  unknown,  modeled  portion  of  the  plant  is  high  and  their 
damping  is  low.  Since  LS  minimizes  the  sum  of  the  squared  equation  error  without  regard 
to  its  whiteness,  the  result  is  the  identification  of  false  high-frequency  dynamics  which  fit 
the  high-frequency  measured  plant  output.  Thus,  the  very  feature  of  LS  which  leads  to  a 
single,  unique  minimum  solution  of  a  quadratic  performance  index  causes  parameter  bias. 

An  effective  way  to  whiten  the  equation-error  and  get  accurate  identification  from 
least-squares  is  to  prefilter  the  plant  input /output  data  by  the  reciprocal  of  the  plant 
characteristic  equation.  Since  this  equation  is  presumed  unknown  perhaps  except  for  the 
rigid  body  poles,  this  method  can  only  partially  be  implemented  practically. 

Other  well-known  methods  such  a  RML2,  RMLl  and  Steiglitz-McBride  essentially  can 


118 


be  viewed  a a  recursively  updating  a  filter  based  on  the  current  estimate  of  the  characteristic 
equation  coming  out  of  the  identification.  These  methods  have  the  potential  of  solving  the 
problem  but  often  converge  slowly  and  to  undesirable  local  minima  in  actual  simulations. 
Thus,  they  tend  to  provide  grossly  biased  results  unless  they  are  started  in  the  vicinity  of 
the  true  solution.  Further,  they  are  quite  computationally  intensive  relative  to  LS. 

Instrumental  variable  identification  may  be  used  to  deal  with  plant  measurement  noise, 
but  requires  a  reference  signal  that  is  uncorrelated  with  the  noise.  This  poses  a  difficult 
problem  for  closed-loop  identification,  where  the  plant  input  is  in  part  derived  from  the 
measured  plant  output.  Methods  that  attempt  to  overcome  this  problem  end  up  either 
adding  test  signals  into  the  loop  and/or  identifying  the  closed-loop  system,  which  is  of 
much  higher  order  than  the  plant  itself. 


“Modified  FRLS  Identification* 

The  method  of  prefiltering  used  in  FWRLS  does  not  solve  this  problem  even  in  part 
because  the  equation-error  remains  colored  by  the  entire  plant  characteristic  equation. 
However,  an  improved  FLS  scheme  that  filters  only  the  plant  input  data  by  the  known 
plant  numerator  polynomial  divided  by  the  stabilised  (radially  projected)  known  plant 
characteristic  polynomial  results  in  equation  error  colored  only  by  the  unknown  portion  of 
the  plant  characteristic  equation.  This  technique,  which  shall  be  called  ‘Modified  FRLS’, 
helps  appreciably.  Essentially,  when  applied  to  the  Four-Disk  System,  it  whitens  the 
equation-error  by  eliminating  the  effect  of  the  two  rigid-body  poles  of  the  plant. 


Artificial  Perturbation  or  “Buss" 

Simply  adding  white-noise  buss  to  the  closed-loop  system  to  improve  the  unfiltered  LS 
identification  does  not  necessarily  help  much  by  itself.  The  necessary  levels  of  white  noise 
or  buzz  necessary  to  overcome  the  identification  difficulties  experienced  with  measurement 
noise  in  lightly-damped  plants  may  be  so  large  as  to  make  this  method  alone  ineffective  as 
was  seen  in  the  Four-Disk  System  simulations. 

However,  in  combination  with  some  of  the  other  methods  described  here  it  may  be 
both  useful  and  necessary  to  buzz  the  plant  at  low  levels  at  some  or  all  times  in  order 
to  keep  the  identification  sensitive  to  step  changes  in  plant  parameters  during  quiescent 
periods.  The  goal  is  to  maximize  the  effectiveness  of  the  perturbation  signal  to  facilitate 
fast  identification  while  limiting  its  effect  on  system  performance.  Thus,  buzz  ideally 
should  be  limited  in  frequency  to  those  portions  of  the  spectrum  where  modeled  dynamics 
that  need  to  be  identified  exist. 


Pre-Filtering  of  Plant  Input/Output  Data: 

In  most  situations  the  upper  frequency  limit  of  modeled  dynamics  is  known.  By 
low-pass  filtering  the  plant  input/output  data  with  a  high-order  digital  low-pass  filter 
with  a  band-edge  just  above  this  limit,  several  very  beneficial  results  were  obtained.  The 
signal/noise  ratio  of  the  data  to  the  identification  is  improved  by  reducing  the  effect  of 
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measurement  noise  on  equation-error  without  significantly  affecting  the  signal  energy  asso¬ 
ciated  with  the  modeled  dynamics  of  the  plant.  Since  LS  identification  will  tend  to  identify 
dynamics  only  in  frequency  bands  where  input /output  signal  energy  exists,  the  problem  of 
estimating  phantom  high-frequency  modes  from  noisy  data  is  greatly  minimized  with  this 
method.  Unmodeled  high-frequency  dynamics  will  also  be  far  less  likely  to  bias  the  iden¬ 
tification  since  the  filter  masks  them  out.  Because  this  filtering  is  not  in  the  closed-loop, 
it  does  not  directly  affect  system  performance  other  than  through  the  adaptation  process. 

Typically,  a  low-frequency  limit  of  modeled  but  unknown  dynamics  is  also  known. 
By  adding  a  digital  high-pass  filter  with  zero  dc  gain  on  the  plant  input/output  data 
to  the  identification,  the  effects  of  position  sensor  offset  and  actuator  dc  bias  forces  bay 
be  eliminated  as  contributors  to  identification  parameter  estimate  bias.  This  technique 
compliments  Modified  FLS  since  in  that  method  the  plant's  dc  dynamics,  the  rigid- body 
poles,  are  removed  from  the  identification.  Obviously,  it  is  not  necessary  to  pass  dc  or 
vety  low-frequency  components  of  the  input/output  data  to  the  identification  since  there 
is  nothing  to  identify  there. 

The  combination  of  these  two  filter  types  is  a  fiat-topped  bandpass  filter  that  windows 
the  frequency  band  in  which  the  unknown  modeled  dynamics  are  known  to  reside.  This 
technique  in  combination  with  the  Modified  FLS  method  seems  to  do  an  excellent  job  of 
identification  with  measurement  noise  and  in  relatively  short  time  periods. 


“Adidas’  —  Assumed-Damping  Identification  for  Adaptive  Servos 

One  feature  of  the  Four-Disk  System  and  many  servo  systems  that  drive  flexible 
structures  is  its  very  light  damping.  It  is  possible  to  make  use  of  this  information  in  order  to 
simultaneously  improve  the  quality  of  identification  and  reduce  the  number  of  identification 
parameters  almost  in  half  again  (from  nine  to  five).  The  number  five  corresponds  to  the 
number  of  degrees  of  freedom  in  plant  parameter  space:  the  frequencies  of  three  resonances 
and  one  antiresonance  and  the  gain  of  the  overall  transfer  function. 

Incidentally,  estimating  this  overall  gain  factor  is  crucial  in  many  systems  due  to  its 
variability;  the  Four-Disk  System  has  proved  not  to  be  an  exception. 

Essentially  this  technique  assumes  that  all  the  plant  poles  and  zeroes  are  at  the  same, 
known  radius  from  the  Z  plane  origin.  For  lightly-damped  systems  the  ‘known’  radius 
is  just  slightly  less  than  one.  The  reduction  in  the  number  of  ARMA  parameters  comes 
from  the  resulting  symmetry  in  the  coefficients  of  the  plant  numerator  and  denominator 
polynomials.  For  example,  the  first  and  last  coefficients  of  the  characteristic  equation  are 
the  same  by  a  factor  of  radius  to  the  nth  power,  where  n  is  the  order  of  the  polynomial. 
The  second  and  next  to  last  coefficients  are  the  same  by  a  factor  of  radius  to  the  (n-2)th 
power  and  so  on. 

This  method  also  compliments  Modified  FLS  since  only  lightly-damped  complex  poles 
and  zeroes  are  left  in  the  identification  problem  for  flexible  mechanical  plants.  Results  indi¬ 
cate  faster  convergence,  more  accurate  estimation  of  resonant  frequencies  and  as  expected 
very  good  damping  or  pole-zero  radii  accuracy.  Lastly,  computation  time  should  be  down 
by  an  order  of  magnitude  versus  the  original  sixteen  parameter  LS  identification. 
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Overparameterization: 

Overparameterization  is  another  means  of  whitening  the  equation  error  and  accurately 
estimating  the  actual  poles  of  the  system.  Simulation  runs  for  the  Four-Disk  System  show 
that  at  least  doubling  the  number  of  parameters  of  the  LS  identification  yields  numerator 
and  denominator  polynomials  whose  roots  include  values  that  are  quite  close  to  the  true 
complex  poles  and  zeroes  of  the  system  even  without  pre-filtering  in  the  presence  of  mea¬ 
surement  noise.  In  the  case  of  zero  measurement  noise,  the  excess  estimated  poles  exactly 
cancelled  the  excess  estimated  zeroes. 

However,  this  was  not  the  case  with  measurement  noise  present,  and  there  appears  no 
easy  on-line  method  to  extract  the  true  plant  poles  and  zeroes  from  the  overparameterized 
model  at  this  time. 

These  effects  have  also  been  demonstrated  first  with  the  Electronic  Four  Disk  System, 
an  equivalent  electronic  version  of  the  Four-Disk  Mechanical  System,  using  a  Genrad  GR- 
2515  structural  analyzer.  The  pole-zero  cancellation  effect  identification  does  not  appear 
to  be  any  more  straightforward  even  with  a  twenty-fourth  order  identification  model,  one 
thousand  sample  points  and  low-pass  pre-filtering. 

In  the  coming  year  we  shall  proceed  with  experiments  on  the  Four-Disk  Mechanical 
System  of  Fig.  3d.-l. 

APPROACH  3:  Real  Time  Frequency  Identification 

This  Approach  was  pursued  by  Wen  Wie  Chiang  for  future  use  with  his  Flexible  Arm 
with  Quick  Wrist,  and  was  demonstrated  by  him  on  a  Two-Disk  Mechanical  System  in  the 
second  year  of  his  contract. 

It  is  shown  clearly  that  the  vibration  associated  with  the  third  structural  mode,  at 
a  frequency  higher  than  the  control  bandwidth,  shows  up  in  the  wrist’s  tip  position  in 
both  the  mechanical  system  maneuvers,  and  in  the  theoretical  numerical  analysis.  What 
is  discussed  here  is  whether  this  mode  can  be  suppressed,  even  though  it  is  beyond  the 
control  bandwidth. 

In  the  mechanical  experimental  wrist-beam  system,  the  third  structural  mode  can¬ 
not  be  modeled  correctly  and  easily  since  it  is  coupled  with  the  vertical  vibration  of  the 
structure  which  cannot  be  described  with  linear  equations.  This  mode  oscillating  at  10  Hz 
cannot  be  controlled  by  the  hub  motor  loop  running  at  25  Hz,  nor  can  its  effect  on  the 
wrist  tip’s  motion  be  suppressed  by  the  wrist  motor  control  loop  with  a  bandwidth  of 
4.6  Hz. 

Numerical  analysis  shows  that  the  effect  of  the  third  mode  still  cannot  be  eliminated 
even  if  we  include  its  model  in  the  controller  designs,  unless  a  very  heavy  penalty  is 
imposed  upon  it  in  the  LQG  design,  or  an  exact  pole-zero  cancellation  is  chosen  in  the 
pole  placement  design,  both  of  which  require  a  very  accurate  model  of  the  system  dynamics. 

Another  option  is  to  use  an  adaptive  control  scheme  that  identifies  the  system  dy¬ 
namics  and  updates  the  controller  parameters  in  real  time.  A  feedforward  filter  will  be 
sufficient  since  the  third  mode  is  at  a  frequency  higher  than  the  control  bandwidth,  and 
a  feedforward  filter  can  avoid  exciting  it  by  notching  out  the  proper  frequency  component 


out  of  the  motion  commands.  The  stability  of  the  system  with  the  existing  feedback  con¬ 
troller  will  not  be  changed  by  a  feedforward  filter,  nor  will  it  be  influenced  by  the  dynamics 
of  the  adaptation  algorithm. 

It  is  not  necessary  to  identify  the  whole  dynamics  of  the  system  for  implementing  the 
adaptive  feedforward  filter,  only  the  frequency  of  the  third  structural  mode  is  required; 
and  it  can  be  done  fast  with  a  new  frequency  identification  scheme  -  that  is  the  subject 
of  this  section.  The  same  frequency  identification  scheme  may  also  be  used  to  identify  the 
first  structural  frequency  of  the  main  beam  to  tune  an  adaptive  feedback  controller  for 
the  hub  motor  loop,  in  order  to  achieve  a  high  performance  in  the  presence  of  modeling 
uncertainty. 

The  transfer  function  from  the  hub  motor  torque  input  to  the  tip  position  of  a  flexible 
beam  has  positive  residues  for  the  rigid  body  and  all  even  numbered  flexible  modes,  and 
negative  residues  for  all  odd  numbered  modes.  It  is  the  odd  numbered  flexible  modes  that 
cause  phase  reversal  of  the  feedback  control  signal  and  destabilize  the  closed  loop  system. 

Only  the  frequency  of  the  first  flexible  mode  is  important  since  the  ultimate  perfor¬ 
mance  of  a  controller  is  still  limited  by  this  mode  even  when  an  exact  dynamic  model  of 
the  system  is  available  to  design  the  controller. 

A  closed  loop  adaptive  controller  is  much  more  difficult  to  design,  since  the  dynamics 
of  the  feedback  controller  interacts  with  that  of  the  system  identification  algorithm,  and  the 
overall  system  stability  must  be  ensured  while  achieving  a  good  performance  in  reasonable 
time. 

Neither  the  feedforward  adaptive  filter  nor  the  feedback  adaptive  controller  has  been 
designed  and  implemented  for  the  wrist-beam  system,  but  the  design  of  the  frequency  iden¬ 
tification  algorithm  has  been  completed  and  tested  successfully  in  a  closed-loop  adaptive 
feedback  controller  for  another  mechanical  system  with  low  damping,  flexible  structure, 
and  non-colocated  actuator-sensor  pair. 

The  Frequency  Identification  Scheme 

The  frequency  identification  scheme  originates  from  the  popular  Phase-Locked-Loop 
(PLL),  and  the  theory  of  its  operation  is  described  briefly  in  this  section.  The  character  of 
this  loop  is  discussed  along  with  the  reason  for  its  inadequacy  for  frequency  identification 
in  adaptive  controls. 

It  is  described  later  in  this  section  how  the  PLL  is  modified  to  serve  the  need  of  the 
adaptive  controls. 


The  Phase>Locked-Loop 

PLLs  have  been  used  widely  in  electronic  engineering  applications.  They  are  used 
primarily  for  synchronizing  clocks  with  external  signals.  A  PLL  has  the  ability  to  identify 
the  phase  and  frequency  of  a  signal  contaminated  by  a  relatively  large  amount  of  noise 
at  other  frequencies.  The  loop  works  by  tracking  the  phase  of  an  external  signal,  which 
results  in  locking  onto  the  correct  frequency. 
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Fig.  3d.-7  shows  the  block  diagram  of  an  analog  PLL.  A  voltage  controlled  oscillator 
(VCO)  generates  a  sinusoidal  signal  with  the  frequency  determined  by  its  input  voltage  ui. 
The  sinusoidal  output,  which  is  the  output  of  the  PLL  also,  is  multiplied  by  the  external 
(input)  signal,  and  the  product  is  low-passed  to  retain  the  component  which  is  a  function 
of  the  phase  error  between  the  input  and  output  signals.  The  signal  due  to  the  phase 
difference  is  used  to  correct  the  frequency  of  the  VCO  until  a  steady  state  is  reached. 

Their  performance  depends  on  how  the  low-pass  filter  is  implemented,  and  how  the 
phase  error  signal  is  processed  to  adjust  the  VCO  frequency.  Linear  analysis  can  be 
performed  for  small  frequency  and/or  phase  errors;  but  the  dynamic  characteristics  of 
such  systems  are  difficult  to  analyze  due  to  their  nonlinearity,  and  test  results  are  not  easy 
to  characterize  either.  PLLs  usually  have  different  searching  ranges  and  holding  ranges, 
and  the  former  are  usually  smaller  than  the  latter. 

PLLs  have  some  properties  that  make  them  unsuitable  for  frequency  identification  in 
adaptive  controls: 

1.  Performance  is  hard  to  predict  and  describe  due  to  the  nonlinearity  as  mentioned 
earlier.  Therefore,  it  is  hard  to  use  them  in  an  adaptive  controller  design. 

2.  Relatively  small  searching  range  makes  the  performance  of  the  adaptive  controller 
unacceptable. 

3.  They  have  higher  sensitivity  to  phase  error  than  to  frequency  error,  which  is  unsuit¬ 
able  for  adaptive  control,  since  the  frequency  identification  will  be  disturbed  by  the 
random  phase  of  the  sensor  signal  every  time  a  new  position  command  or  an  exter¬ 
nal  disturbance  is  applied  to  the  system,  even  after  the  frequency  has  been  identified 
already. 

4.  Responses  are  sensitive  to  the  amplitude  of  the  input  signal,  and  a  high  gain  ampli¬ 
fication  is  required  to  saturate  the  input  channel  to  reduce  this  sensitivity.  However, 
such  a  saturation  changes  the  frequency  component  of  the  input  signal,  and  makes  it 
harder  for  multiple  frequency  identification. 

The  Frequency- Locked- Loop 

The  author  has  made  modification  to  a  PLL  to  eliminate  its  sensitivity  to  phase  in  the 
input  signal  and  make  the  input /output  relation  much  more  linear  in  a  larger  searching 
and  holding  range,  so  that  it  works  better  for  frequency  identification,  while  retaining  the 
other  virtues  of  PLL’s.  The  final  product,  called  a  Frequency- Locked-Loop  (FLL),  is  shown 
schematically  in  Fig.  3d.-8a.  It  shows  that  the  FLL  uses  one  more  multiplier,  three  more 
low  pass  filters,  and  a  trigonometric  function  than  the  PLL  does,  so  that  it  can  obtain  a 
signal  which  is  proportional  to  the  frequency  error  between  the  input  and  output  signals  of 
the  loop.  Its  input/output  relation  can  be  seen  from  the  functional  block  diagram  shown 
in  Fig.  3d.-8b,  where  u /,•  is  the  frequency  of  the  input  signal  and  u0  is  the  output  signal 
—  the  frequency  detected  by  the  FLL.  Also  shown  in  the  same  block  diagram  are  u„  the 
starting  oscillation  frequency;  Aw,  the  correction  on  the  output;  and  <*>„,  the  error  of  the 
output  of  the  FLL. 

The  character  of  the  block  G(a)  can  be  chosen  arbitrarily  by  the  designer  as  long  as 
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it  can  update  the  output  frequency  of  the  FLL  according  to  its  error  The  most  easy 
way  is  to  use  an  integrator  G/a  and  the  FLL  will  have  a  pole  at  —  K  where 

K  =  G{a-  6) 
ab  . 

Parameters  a  and  b  should  be  determined  with  the  following  restriction 

u„  >  a  >  b  >  /ui  -  u0 / 

where  u„  is  the  nominal  frequency  the  FLL  is  working  at,  and  /w,-  —  u0/  represents  the 
working  range  in  frequency. 

With  the  parameters  chosen  as  above,  the  block  diagram  in  Fig.  3d.-8b  can  be  ex¬ 
pressed  with  the  transfer  function 

n.M 

«.  M  =  tSz  • 

For  example,  a  set  of  values  are  chosen  for  the  parameters  in  a  design  as 


a  =  6.0  ,  6  =  4.0  ,  G  =  20.0 

where  the  nominal  working  frequency  is 

un  =  \Z.Zrad/aec 

and  the  desired  linear  searching  range  is 


K  =  1.67  , 


/<*;,■  -  u0/  =  un 
4  =  3.3 rad/ sec  . 

Fig.  3d.- 10  shows  the  tested  result  of  the  FLL’s  output  when  the  frequency  of  the 
input  signal  is  changed  suddenly.  The  response  for  a  small  input  change  (the  first  change 
in  Fig.  3d.-10a)  is  similar  to  the  step  response  of  a  first-order  filter  with  a  pole  at  —K,  as 
shown  in  Fig.  3d.-10b.  The  response  for  a  large  input  change  which  is  much  larger  than  the 
designed  linear  searching  range  experienced  some  nonlinearity  at  the  beginning  because 
the  FLL’s  internal  structural  is  not  linear;  however,  the  FLL  still  tracked  the  input  signal 
and  provided  the  correct  output  in  a  reasonable  time. 

The  almost  linear  behavior  of  the  FLL  over  a  large  working  range  makes  it  very 
suitable  for  frequency  identification  in  real-time  adaptive  controls. 


Fig.  3d. -10  gtep  response  of  the  FLL  (a),  compared  with  that  of  a  first-order  filter  (b)  with 
the  same  pole  location  «  *  -1.67*ee-1. 
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Using  the  FLL  in  an  Adaptive  Closed* Loop  Controller:  Experimental  Demon¬ 
stration 

The  feasibility  of  using  the  FLL  in  adaptive  control  has  been  demonstrated  in  an 
adaptive  closed-loop  controller  for  another  mechanical  system  built  in  the  Stanford  Aero¬ 
nautics  and  Astronautics  Robotics  Laboratory.  The  system  consists  of  two  circular  disks 
connected  by  a  torsional  rod.  The  system  has  inherently  extremely  low  damping,  and  the 
actuator  (DC  motor)  and  the  sensor  (RVDT)  are  mounted  on  different  disks.  The  natural 
frequency  of  the  system  is  2.11  Hz  (  13.3 rad/ sec.  )  and  the  damping  of  that  mode  is  less 
than  0.004.  A  high  performance  controller  is  designed  using  LQG  algorithm  which  synthe¬ 
size  a  state  estimator  for  state  feedback  control.  The  value  of  the  natural  frequency  is  an 
important  parameter  in  implementing  the  state  estimator,  and  it  is  the  one  to  be  updated 
by  the  adaptation  algorithm.  An  off  nominal  value  of  the  natural  frequency  can  be  used 
for  the  initial  controller  design  to  test  the  performance  of  the  adaptation  algorithm. 

The  commanded  system  output  is  converted  to  its  corresponding  state  command  x(, 
which  is  then  compared  with  the  estimated  state  &  to  calculate  the  feedback  control  effort 
u.  For  parameter  identification,  in  principle,  any  signal  containing  the  vibration  mode 
to  be  identified  can  be  used  to  drive  the  FLL,  but  it  is  found  experimentally  that  the 
estimation  error  of  the  system  output  defined  as 

y  =  y-y 

is  the  best  one  to  use  since  it  will  not  be  disturbed  by  any  command  change  if  there  is  no 
modeling  error  in  the  state  estimator.  The  output  of  the  FLL  iB  compared  with  the  value 
of  the  natural  frequency  used  in  the  state  estimator,  and  the  error  in  the  latter  is  corrected 
according  to  a  parameter  updating  algorithm. 

The  dynamics  of  the  parameter  variation,  identification,  and  correction  interact  with 
each  other  when  the  adaptation  loop  is  closed.  The  parameter  dynamics  of  the  entire 
system  can  be  expressed  as  the  block  diagram  shown  in  Fig.  3d.-9,  where  un  is  the  open-loop 
natural  frequency  of  the  plant,  we  is  the  corresponding  value  used  in  the  state  estimator, 
ut  is  the  most  critical  closed-loop  modal  frequency,  and  u>0  is  the  output  of  the  FLL.  The 
relationship  between  ue,  u„,  and  u,  can  be  obtained  by  analyzing  the  closed  loop  system 
for  its  modal  frequencies.  The  relation  is  then  linearized  to  simplify  the  design  for  the 
parameter  adaptation  algorithm.  The  difference  between  u>0  and  ue  is  used  to  correct 
the  error  of  the  parameter,  we,  in  the  controller  through  an  integrator,  and  this  parameter 
updating  scheme  is  designed  using  a  classical  control  design  method,  namely  the  root  locus 
method,  because  the  FLL’s  behavior  is  almost  linear. 

The  value  of  K  in  the  FLL  is  chosen  to  be  1.67 rad/ see  as  described  before;  and  the 
integration  constant  H  is  chosen  to  be  9.9  which  results  in  the  fastest  response  of  the 
parameter  correction  loop  with  closed  loop  poles  at  s  =  -5.8 raifstc.  The  detail  of  the 
analysis  and  design  of  the  adaptive  control  system  is  described  in  a  previously  published 
paper  by  the  author.  The  ratio  of  the  value  of  the  adaptation  pole  (  -5.8 rad/ sec  )  to  that 
of  the  natural  frequency  of  the  uncontrolled  mechanical  system  (  13.3 rad/ sec  )  is  so  high 
that  the  adaptation  speed  of  this  algorithm  can  be  considered  as  very  fast.  In  principle, 
other  linear  control  design  algorithms  can  also  be  used  to  design  the  parameter  updating 
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scheme,  as  long  as  the  FLL  behaves  almost  linear. 


Figure  3d.- 11  shows  the  tested  responses  of  the  mechanical  two-disk  system  under  the 
adaptive  closed-loop  control  with  significant  initial  parameter  error  in  the  controller. 

The  control  system  becomes  unstable  if  the  modeling  error  in  plant’s  natural  frequency 
is  more  than  10%.  Figure  3d.- 11a  shows  that  the  system  is  initially  unstable  and  starts 
oscillating  when  the  control  system  is  just  turned  on.  However,  the  adaptation  algorithm 
starts  working  immediately  and  stabilises  the  system  within  two  cycles  of  oscillation.  The 
responses  for  the  subsequent  step  commands  look  almost  identical  to  those  when  using  a 
fixed  controller  with  no  modeling  error.  The  adaptation  takes  effect  in  less  than  one  second 
on  a  lightly  damped  mechanical  system  which  might  be  the  first  one,  with  time  constant 
shorter  than  one  second,  having  been  successfully  controlled  by  a  fast  adaptive  system. 


It  can  be  noted  from  Fig.  3d.-lla  that  a  small  amplitude  vibration  builds  up  after  the 
system  becomes  stable.  This  phenomenon  can  be  attributed  to  the  lack  of  signal  to  excite 
the  FLL,  and  causing  its  output  to  drift  away.  However,  the  FLL  catches  the  vibration, 
corrects  the  parameter  error  and  suppresses  the  vibration  before  the  instability  has  the 
chance  to  grow  up.  This  interesting  behavior  can  be  related  to  the  "minimum  excitation” 
required  by  other  types  of  adaptive  algorithm. 


Fig.  3d.-llb  shows  the  test  when  the  initial  modeling  error  is  50%  in  the  plant  fre¬ 
quency.  Beside  making  the  initial  control  system  unstable,  the  large  parameter  error  also 
exceeds  the  linear  design  range  of  the  FLL.  The  test  shows  that  the  frequency  identifica¬ 
tion  and  the  parameter  adaptation  scheme  still  work;  it  only  takes  a  little  more  time  to 
stabilize  the  system.  The  responses  for  the  subsequent  step  commands  show  no  sign  of  the 
initially  large  modeling  error. 

Judging  from  the  success  of  the  adaptive  closed-loop  control  system  for  the  two-disk 
mechanical  system,  we  can  envision  that  the  FLL  will  be  able  to  identify  the  vibration 
frequency  and  drive  an  adaptive  filter/controller  adequately  for  a  wrist- beam  system. 
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TECHNICAL  REPORT  ON  TASK  4: 
INTEGRATED  TACTILE  SENSOR3 


Objective,  Design  Goals,  and  Development  Plan 

The  overall  objective  of  this  Task  was  to  explore  the  use  of  an  integrated  circuit 
pressure  sensor  as  the  basis  of  a  tactile  sensor  for  robotics  applications.*  A  tactile  sensor 
is  a  contact  sensor  which  provides  a  spatial  array  of  force  information.  It  is  anticipated 
that  such  sensors  will  find  many  applications  in  the  robotics  perception  of  the  shape, 
orientation,  texture,  and  slip  of  objects. 

Most  arrays  feature  random  data  access.  At  its  simplest,  the  number  of  data  lines  must 
equal  the  sum  of  N  columns  and  M  rows  plus  one.  In  more  complicated  configurations, 
address  bus  and  decoding  circuitry  allow  a  data  bus  for  a  reduction  in  sensor  connections 
[Raibert].  Wider  busses  and  increased  power  dissipation  in  larger  arrays,  however,  will 
both  limit  spatial  resolution  and  reduce  reliability.  In  both  cases,  additional  electronics 
are  required  to  scan  the  array  and  must  incorporate  an  algorithm  for  the  detection  of  and 
recovery  from  defective  sensing  elements. 

Some  quantitative  specifications  for  the  performance  of  a  tactile  array  were  available 


in  the  literature  [Harmon]: 

1.  spatial  resolution 

2mm 

2.  array  dimensions 

10  x  10 

3.  response  time 

0.01  -  0.1  s 

4.  dynamic  range 

£500 

In  addition,  for  use  in  the  industrial  environment,  a  tactile  sensor  is  required  to  be: 

5.  immune  to  electromagnetic  interference 

6.  insensitive  to  temperature 

7.  mechanically  rugged 

8.  stable 

9.  easy  to  calibrate 

These  requirements  led  to  a  number  of  decisions  regarding  the  design  goals  for  the 
Task.  For  a  dynamic  range  £500  in  pressure,  a  capacitive  rather  than  a  piezoresistive 
transduction  technique  was  selected  due  to  its  much  greater  sensitivity.  For  immunity  to 
electromagnetic  interference,  a  digital  rather  than  an  analog  data  format  was  selected.  To 
permit  real-time  external  compensation  for  manufacturing  variabilities  and  temperature 
effects,  it  was  decided  that  the  sensor  should  provide  temperature,  zero-offset,  and  gain 
in  addition  to  pressure  information.  To  maximize  reliability,  the  number  of  electrical 
connections  to  the  array  was  to  be  minimized.  This  required  that  the  output  signals  of  the 

*  Refer  to  Section  Bl,  r.  of  the  Contract  Statement  of  Work,  tehich  itatee:  ‘Inveitigate  the  ate  of  tUicon 
integrated  circuit  technology  to  achieve  altraminiatare  prettare  teruort.  * 
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various  pressure  sensing  elements  in  the  anay  be  multiplexed  onto  a  single  serial  output 
line.  For  10  x  10  array  dimensions  and  a  response  time  of  0.01  -  0.1  s,  therefore,  each 
pressure-sensing  element  in  the  array  had  to  update  its  output  signals  each  0.0001  to  0.001 
s.  Finally,  to  ensure  stability  of  the  sensor,  it  was  to  be  hermetically  sealed  and  comprised 
of  the  minimum  number  of  parts. 

The  Task  was  divided  into  three  subtasks  to  be  conducted  in  two  stages.  The  subtasks 
were: 

1.  an  integrated  circuit  which  would  generate  pressure  and  calibration  signals.  This 
circuit,  which  was  to  transduce  capacitance  to  an  asynchronous  digital  output,  was 
termed  a  Capacitive  Pressure  Transducer  (CPT); 

2.  an  integrated  circuit  which  would  be  the  array  system  manager.  This  circuit,  which 
would  multiplex  signals  from  the  various  array  elements,  detect  and  recover  from  non¬ 
functional  elements,  etc.,  was  termed  an  Asynchronous  Digital  Multiplexer  (ADM); 

3.  micromachining.  This  subtask  was  to  be  concerned  with  the  fabrication  of  integrated 
pressure-sensitive  capacitors,  hermetic  sealing,  electrical  contract  through  the  her¬ 
metic  encloser,  etc. 

The  two  stages  of  the  development  plan  were: 

1.  separate  development  of  the  subtasks;  and 

2.  merger  of  the  subtasks  into  a  functional  array,  including 

a.  merger  of  the  micromachining  and  CPT  subtasks  into  a  functional  pressure  sensor; 
and 

b.  merger  of  ADM  and  many  pressure  sensors  into  a  functional  tactile  array. 
During  this  funding  period,  only  goals  within  the  first  stage  were  achieved. 


Status  of  the  Research  Effort 


The  goal  of  this  subtask  was  to  construct  a  custom  integrated  circuit  for  a  small, 
accurate,  low-power  capacitive  pressure  transducer  which  is  the  key  element  of  a  pressure¬ 
sensing  array. 

This  subtask  has  been  completed  during  the  current  funding  period,  culminating  in 
the  successful  demonstration  of  the  custom  integrated  circuit  for  use  with  a  capacitive 
pressure  transducer  [Smith,  May  1985].  A  photomicrograph  of  several  of  the  integrated 
circuits  appears  in  Figure  4-1. 


System  Architecture 

Figure  4-2  illustrates  the  block  diagram  of  the  integrated  circuit.  The  component  sub¬ 
circuits  include  an  integrated  bandgap  temperature  reference,  a  Schmitt  trigger  oscillator, 
and  digital  logic.  The  multiplexed  asynchronous  digital  data  format  appears  in  Figure  4-3. 
The  ratiometric  calibration  scheme  which  utilizes  zero-offset  and  gain  information  for  the 
measurement  of  pressure- sensitive  capacitance  and  temperature  are  illustrated  in  Figure 
4-4  and  4-5. 

System  Performance 

Results  taken  from  6  chips  show  the  accuracy  of  pressure-sensitive  capacitance  and 
temperature.  Figure  4-6  illustrates  the  demodulated  temperature  signal  as  a  function  of 
temperature.  Note  that  the  temperature  sensitivity  of  the  circuit  is  almost  precisely  the 
theoretical  3333  ppm/degC.  Figure  4-7  shows  the  pressure  signal  period  as  a  function  of  ca¬ 
pacitance,  temperature,  and  supply  voltage.  The  pressure  sensitivity  is  3300  ppm/mmHg. 

Since  zero-offset  and  gain  and  effects  on  accuracy  are  entirely  eliminated  by  the  ra¬ 
tiometric  measurement  scheme,  accuracy  is  limited  only  by  errors  in  capacitance  and  tem¬ 
perature  measurements. 

Subtask  Status 

The  integrated  circuit  layout  contains  all  the  features  necessary  to  construct  a  mono¬ 
lithic  transducer.  The  first  batch  fabrication  run  containing  135  transducers  is  currently 
in  process  in  the  Stanford  Integrated  Circuits  Laboratory.  These  devices  will  be  tested  at 
the  circuit  level  before  being  packaged  as  transducers. 

In  addition,  components  of  a  precision  calibration  apparatus  for  pressure  and  temper¬ 
ature  were  acquired.  This  apparatus  is  in  the  process  of  being  assembled  and  tested. 


Subtaak  2:  An  Integrated  Circuit  for  Tactile  Array  System  Management 

Our  research  in  tactile  arrays  has  lead  us  to  a  novel  system  architecture.  The  custom 
Asynchronous  Digital  Multiplexer  (ADM)  integrated  circuit  is  an  implementation  of  this 
new  architecture.  It  is  a  first  and  necessary  prototype  to  test  our  methods  that  will  be 
extended  to  produce  tactile  arrays. 

System  Architecture 

The  ADM  combines  the  output  data  signals,  emitted  by  our  tactile  sensors,  onto  a 
single  pair  of  wires  [Shapiro].  In  addition  to  the  data  signal,  each  pressure  sensor  also 
emits  a  sync  signal  to  serve  as  a  data  frame  marker. 

The  ADM  operates  by  using  this  sync  information  from  the  sensors  to  control  the 
multiplexing  of  their  data  signals.  This  two-tiered  multiplexing  scheme  allows  any  form  of 
pulse  modulation  to  be  used  by  the  sensor  as  long  as  the  data  stream  is  properly  framed 
by  a  sync  signal.  Because  the  multiplexing  rate  is  determined  by  the  repetition  rate  of  the 
sync  pulses,  the  sampling  frequency  will  be  determined  by  the  particular  sensors  used  and 
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not  by  the  ADM.  A  handshake  signal  for  each  sensor  permits  uniform  sampling  with  the 
synchronization  of  the  sensors.  T  is  same  signal  also  can  be  used  to  initiate  power  to  the 
sensor  in  pulse-powering  applications  where  system  current  drain  must  be  minimized.  A 
block  diagram  of  the  ADM  integrated  circuit  appears  in  Figure  4-8. 

A  potential  disadvantage  of  a  self-clocked  multiplexer  is  that  if  any  sensor  fails,  the 
counter  in  the  control  logic  stops  and  the  ADM  doesn’t  advance  to  the  next  channel.  To 
avoid  this,  a  special  circuit  monitors  the  sync  signals  emitted  by  the  sensors  and  inserts 
a  pulse  when  one  is  missing  to  advance  the  counter.  An  added  benefit  of  this  circuit  is 
that  it  aids  the  start-up  of  the  ADM  when  the  IC  is  powered.  In  addition,  the  ADM 
logic  is  always  properly  initialized  on  start-up  because  of  the  recursion  that  is  inherent  in 
the  system  architecture:  the  sensor  that  is  being  multiplexed  is  the  same  sensor  that  is 
clocking  the  multiplexer. 

To  test  our  new  architecture,  a  gate-level  logic  simulation  of  the  ADM  digital  design 
was  performed  using  SALOGS,  a  program  developed  by  Sandia  for  the  Department  of 
Energy.  Four  free-running  sensors,  each  with  3  channels  of  data,  were  connected  to  the 
ADM  and  the  logic  design  was  verified. 

ADM  Circuitry 

The  ADM  circuitry  consists  of  three  main  components:  a  data  multiplexer,  sync 
multiplexer  and  control  logic.  The  sync  multiplexer  and  control  logic  need  not  be  high 
speed  because  both  circuits  are  operated  at  about  3.33kHz  (300us)  —  the  frame  rate  of 
the  data  from  the  tactile  sensor.  The  data  multiplexer  must  be  high-speed,  however,  to 
preserve  the  purity  of  the  pulse  edges  so  that  the  large  dynamic  range  achieved  by  the 
pressure  sensor  array  elements  is  maintained.  Although  the  repetition  rate  of  the  pulses 
from  the  pressure  sensors  is  relatively  slow  (a  period  of  50us),  an  RMS  jitter  of  only  15ns 
would  reduce  the  dynamic  range  to  300ppm.  Because  of  the  special  speed  and  power 
requirements  of  the  ADM,  both  I2L  and  EFL  bipolar  logic  is  used.  EFL  with  its  multi- 
emitter  input  transistor  is  a  natural  choice  for  the  high-speed  data  multiplexer.  A  simple 
input  stage  that  connects  each  sensor  data  signal  to  the  EFL  multiplexer  was  developed. 
This  input  stage  interfaces  easily  with  the  EFL  multiplexer  and  has  an  input  threshold  of 
about  1.2V.  A  high-speed  low-power  driver  was  designed  to  connect  the  output  of  the  EFL 
multiplexer  with  the  output  buffer.  A  special  buffer  with  bootstrap  circuitry  has  been 
developed  to  enable  the  ADM  to  drive  the  capacitance  associated  with  an  output  cable. 
A  simple  bias  circuit  for  the  EFL  logic  generates  voltage  levels  and  with  tracking  current 
source  for  improved  temperature  stability. 

The  sync  multiplexer  is  implemented  in  I2L  because  of  the  low  speeds  of  the  sync 
signals.  The  input  stage  developed  is  simple  and  interfaces  easily  to  pulse  synchronizers 
which  are  required  when  the  sensors  are  free-running,  in  the  case  when  handshaking  is 
unavailable.  Multiplexing  is  easy  because  of  the  inherent  wired-AND  in  the  I2L  gate: 
the  outputs  from  the  pulse  synchronizers  need  only  be  bussed  to  the  input  gate  of  the 
control  logic.  The  multiplexed  sync  signals  are  connected  to  the  missing  pulse  circuitry 
that  prevents  lock-up  due  to  faulty  sensors.  Missing  pulse  detection  is  accomplished  with 
a  resettable  astable. 

Two  preliminary  versions  of  the  counter  in  the  control  logic  have  been  designed.  A 
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Fig.  4-8  Block  Diagram  of  the  Asynchronous  Digital  Multiplexer  IC 


programmable  version,  to  insure  flexibility,  has  been  designed  so  that  the  ADM  can  mul¬ 
tiplex  2,  4,  6,  or  8  sensors.  An  additional  feature  has  been  implemented  to  allow  sampling 
of  low-bandwidth  signals  at  a  fraction  of  the  rate  required  for  the  regular  data  signals.  A 
simpler  non- programmable  version  has  also  been  designed.  When  implemented  in  a  tactile 
array,  the  counter  will  be  appropriately  extended  for  the  array  dimensions. 


A  I2L-to-EFL  level-shift  circuit,  with  minimal  standby  current  drain,  has  been  devel¬ 
oped  to  interface  the  control  logic  with  the  data  multiplexer.  Similar  circuitry  also  is  used 
to  drive  the  output  buffers  that  emit  the  handshake  signals  from  the  I2L  control  logic. 


Subtask  Status 


The  majority  of  the  circuit  simulation  was  performed  using  HSPICE,  donated  by  Meta- 
Software  of  Cupertino.  Each  of  the  above  mentioned  circuit  blocks,  with  the  exception  of 
the  missing  pulse  detector,  have  been  simulated  successfully.  At  the  time  of  the  writing, 
all  the  blocks  are  being  connected  together  in  order  to  simulate  the  complete  chip:  a  two 
channel  version  of  the  sync  multiplexer  has  been  simulated  with  the  data  multiplexer  soon 
to  be  added.  The  missing  pulse  detector  must  then  be  completed  and  added  into  the  ADM 
simulation. 


Layout  and  fabrication  of  the  ADM  integrated  circuit  follow  the  completion  of  the 
design  and  simulation  of  the  circuitry.  The  circuitry  will  be  fabricated  using  the  Standard 
Bipolar  Process,  developed  by  the  IC  Lab  at  Stanford  University. 


As  mentioned  earlier,  the  ADM  is  only  a  first  step  in  the  development  of  larger  tactile 
arrays  for  robotics.  A  generalization  of  the  architecture  results  when  we  repartition  the 
ADM.  If  we  use  tri-state  or  open  collector  outputs  to  multiplex  both  the  data  and  sync 
signals,  we  can  remove  these  functions  from  the  ADM  chip.  The  control  logic  also  can  be 
partitioned  into  separate  pieces  that  can  be  incorporated  into  each  pressure-sensing  array 
element.  To  do  this,  we  take  advantage  of  the  sequential  nature  in  scanning  the  sensors: 
we  arrange  the  sensors  into  a  shift-register  or  “bucket  brigade”  configuration  so  that  each 
sensor  tells  the  subsequent  one  when  to  power  up  and  start  sensing.  A  common  clock 
line  advances  the  shift-register.  With  serial  rather  than  random  access  to  each  individual 
sensor  in  the  array,  the  number  of  wires  required  for  electrical  connection  to  the  array  is 
independent  of  the  array  dimensions  and  reduced  from  N  +  M  +  1  to  2. 


Many  key  ideas  in  the  ADM  and  the  repartitioned  ADM  are  the  same.  Both  feature 
self-clocked  multiplexing,  missing-pulse  detection  of  defective  elements,  and  pulse- powering 
capability.  The  differences  are  that  the  data  multiplexer  is  now  accomplished  with  a  wired- 
AND  connection  and  control  logic  from  CPT  and  ADM  is  combined  and  simplified. 


Another  potential  disadvantage  of  this  architecture  is  that  a  break  in  any  of  the  bussed 
lines  would  disable  the  array.  A  random  access  array  with  address  bussing,  however,  suffers 
a  similar  problem  and  a  simple  array  could  still  lose  a  complete  row  or  column  of  sensors. 
This  potentiality,  however,  is  common  to  all  bussed  integrated  circuits  and  rarely  presents 
a  problem.  The  likelihood  of  this  problem  is  less  in  rigid  arrays,  such  as  the  one  being 
developed  here,  than  in  flexible  arrays. 


Subtaak  3:  Micromachining 

The  structure  of  the  capacitive  pressure  transducer  prototype  for  the  tactile  array 
element  appears  in  Figure  4-9.  Special  micromachining  techniques  were  required  for  form¬ 
ing  this  three  dimensional  structure,  including  chemical  etching  of  a  pressure  sensitive 
diaphragm  and  of  a  shallow  well  in  glass  for  and  electric  shield  over  the  integrated  circuit, 
laser  drilling  of  electrical  contact  vias  through  glass,  and  electrostatic  bonding  of  glass  and 
silicon. 


Laser  Drilled  Electrical  Contact  Vias  through  Glass 

The  conventional  way  to  protect  integrated  circuits  from  the  corrosive  attack  of  the 
environment  is  by  means  of  hermetically  sealed  packages.  An  integrated  sensor,  however, 
must  be  exposed  to  the  environment  in  order  to  perform  its  transduction  function.  For  in¬ 
tegrated  sensors,  electrostatic  sealing  glass  and  silicon  wafers  is  a  demonstrated  technique 
for  hermetically  protecting  on-board  circuitry  while  exposing  an  on-board  pressure  trans¬ 
ducer  [Sander].  Hermetically  enclosing  a  circuit,  however,  creates  the  problem  of  making 
electrical  contact  to  it.  We  chose  to  drill  electrical  contact  vias  through  the  glass  wafer. 

An  automated  carbon  dioxide  laser  workstation  was  designed  and  built  for  the  purpose 
of  drilling  vias  through  glass  wafers.  The  workstation  interfaced  a  microcomputer  to  an 
X-Y  Table  and  to  a  carbon  dioxide  laser.  The  X-Y  Table  has  a  spatial  resolution  of  5  um 
and  the  laser  has  a  focussed  spot  sise  of  50  um.  This  workstation  was  then  programmed  to 
produce  patterns  of  holes  through  the  glass  wafers  which  mated  with  patterns  of  electrical 
contact  pads  on  underlying  silicon  wafers. 

Conical  vias  with  an  upper  diameter  of  300  um  and  a  lower  diameter  of  um  were 
produced.  Metalization  of  these  holes  produced  electrical  contact  with  resistances  of  less 
than  10  ohms.  [Bowman,  84].  It  was  determined  that  the  following  procedures  were 
essential  to  achieving  a  low  resistance  electrical  contact: 

1.  electrostatic  sealing  of  the  glass  and  silicon  wafers  before  laser  drilling; 

2.  drilling  through  the  glass  with  many  small  laser  pulses  rather  than  with  one  large 
pulse; 

3.  sculpting  the  contour  of  the  drilled  hole  by  moving  the  workpiece  under  the  laser 
during  drilling;  and 

4.  depositing  metal  in  the  drilled  hole  by  sputtering.  A  thickness  of  3  or  more  um  of 
aluminum  was  adequate. 

Chemical  Etching  of  Pressure  Sensitive  Diaphragms 

The  anisotropic  etching  of  pressure  sensitive  diaphragms  is  performed  extensively 
commercially.  Little  information  was  available,  however,  concerning  the  repeatability  of 
the  etching  process.  Processing  information  from  a  large  number  of  diaphragms  in  a  tactile 
array  would  be  greatly  simplified  if  the  etch  rate  were  uniform  across  a  wafer  and  from 
wafer  to  wafer. 

An  experiment  was  performed  to  determine  the  uniformity  of  silicon  etch  rate  in  KOH. 
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V-grooves  of  various  depths  were  etched  and  their  depths  measured.  It  was  determined 
that  the  variation  in  depth  was  0.28  um  in  a  mean  depth  of  40  um.  Projected  to  a  total 
depth  of  140  um  as  would  be  used  in  a  functional  pressure  sensor  or  tactile  array,  the 
variation  in  diaphragm  thickness  would  be  less  than  1  um.  Since  the  diaphragm  thickness 
itself  would  be  approximately  60  um,  this  variation  in  thickness  would  have  little  influence 
upon  sensor  sensitivity. 

Subtask  Status 

The  merger  of  the  micromachining  and  CPT  subtasks  into  a  functional  sensor  remains 
to  be  accomplished. 
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PART  L-  TOE  SCHEDULE 
gTTTON  B  -  SUPPLIES/SEKVTCES  AND  PRICES 


0001  1.  »EgEA»™ 

Tb«  contractor  shall  furnish  laval  of  affort  spaclfiad  in  Secticxi  F. 
toftstfcar  with  all  related  services,  facilities,  supplies  and  materials  needed 
toccnduct  the  research  described  below.  T be  research  shall  be  conducted 

A«ri«^  the  period  specified  in  Section  F. _ _ _ 

-  "*• '  "  “  % 
JOSXHAA  t.  conduct  a  survey  to  identify  key  problems  in  assembly,  test  and 
rework  fn  production  of  airframe,  avionics,  and  propulsion  units. 

b.  Establish  mechanisms  to  maintain  a  continuous  process  of  technology 
transfer. 

c.  Provide  a  Tocus  for  research  to  solve  key  problems  Identified  In  a. 

d.  Develop  components  needed  for  flexible.  Integrated  systens  for 
programmable  automation  for  assembly,  test,  and  rework. 

e.  Develop  Components  needed  for  an  Intermediate  Integrated  system  for 
assembly. 

f.  Analyze  selected,  typical  assemblies  In  AL,  Including  airframes, 
propulsion  systems,  and  avionics. 

g.  Design  and  implement  additions  to  AL,  to  simplify  programming  and 
overcome  limitations  Identified  In  task  d. 

h.  Augment  development  of  the  portable  AL  programming  system  end  aid  In 
distribution  of  AL. 

1.  Develop  preliminary  specifications  for  a  family  of  standardized 
electronic  end  software  Interfaces  for  prograxmable  devices,  especially  robots. 

j.  Develop  adaptive  self-calibration  and  self-alignment  modules  which 
adapt  to  setup  errors  to  cut  setup  time,  modules  which  track  variations  and 
maintain  calibration  during  production  to  Improve  reliability;  develop 
optimization  modules  to  move  along  the  learning  curve  In  speeding  up  assembly 
operations. 

k.  Develop  ACRONYM  connected  to  AL  as  an  Integrated  assembly  system  with 
vision,  force  control,  geometric  modeling,  manipulation,  simulation,  and 
planning. 


153 


**>-  »•— <  of  the 


7.  Develop  visual  control  of  assembly,  using  ACRONYM;  use  visual 
tracking  of  robot  and  parts. _ 

m.  Extend  ACRONYM  to  aid  In  programming  and  Integrating  multiple  test 
functions*  and  aid  in  integrating  test  «dth  assembly. 

~  n.  Extend  the  end-point  control  laws  developed  for  single  link  flexible 
mra  operation  to  two  link  operation  In  the  horizontal  plane  and  Investigate 
“extension  to  the  vertical  plane  dimensions  where  gravity  affects  the  system. 

o.  Investigate  the  capabilities  and  limitations  of  lumped-compliance 
A  +  A  robot  arms.  Specifically*  determine  the  slew  speed*  end-point  settling  time 
and  positioning  accuracy*  proximity  motion*  and  contact-force  performance  for 
a  range  of:  flexibility*  payload  mass  and  Inertia*  actuator  power* 
controller  bandwidth;  and  study  Inherent  actuator  and  sensor  non-linearities. 

”  p.  Extend  the  work  In  tasks  o  and  p  to  robot  arms  with  distributed 
flexibility. 


q.  Investigate  the  performance  to  be  expected  of  the  complete  flexible 
robot  arm  with  end-effector  for  various  real-life  manufacturing*  assembly*  and 
inspection  tasks. 

r.  Investigate  the  use  of  silicon  Integrated  circuit  technology  to 
I  achieve  ultraminiature  pressure  sensors. 


0002  REPORTS 

Reports  identified  below  shall  be  prepared  in  accordance  with  Exhibit  A  to 
this  contract  and  delivered  In  accordance  with  Section  F. 

0002AA  FUNDS  EXPENDITURE  AND  PROJECTION  REPORT 

0002AB  ANNUAL  REPORT 

000 ZAC  FINAL  REPORT 

Other  reports  which  are  or  may  be  required  under  this  contract  are  Identified 
In  Sections  H  and  I. 

See  Section  H,  Paragraph  3  for  pricing  Information. 
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Abstract 

We  show  that  highlights  in  images  of  objects  with 
specularly  reflecting  surfaces  provide  significant  infor¬ 
mation  about  the  surfaces  which  generate  them.  A  brief 
survey  is  given  of  specular  reflectance  models  which  have 
Iven  used  in  computer  vision  and  graphics.  For  our 
work,  we  adopt  the  Torrance -Sparrow  specular  model 
which,  unlike  most  previous  models,  considers  the  un¬ 
derlying  physics  of  specular  reflection  from  rough  sur¬ 
face-'.  From  this  model  we  derive  powerful  relationships 
between  the  properties  of  a  specular  feature  in  an  image 
and  lucid  properties  of  the  corresponding  surface.  Care¬ 
ful  experiments  with  specularly-  reflecting  objects  estab¬ 
lish  the  merit  of  these  relationships. 


1.  Introduction 

Shiny  surfaces  give  us  specular  reflections  (high¬ 
lights).  A  perfectly  smooth  shiny  surface  (c.g.  a  per¬ 
fect  mirror)  reflects  light  only  in  the  direction  such  that 
the  angle  of  incidence  equals  the  angle  of  reflection.  For 
rougher  shiny  surfaces  (c.g  the  surface  of  a  metal  fork), 
specular  effects  arc  still  observable.  In  this  paper  we 
analyse  the  properties  of  specular  reflection  from  rough 
shiny  surfaces. 

There  arc  several  basic  reasons  why  the  study  of 
specular  reflection  deserves  serious  attention  in  com¬ 
puter  vision.  Specular  features  are  almost  always  the 
brightest  regions  in  an  image.  Contrast  is  often  very 
large  across  spccularitics;  they  are  very  prominent.  This 
makes  them  easy  to  locate.  In  addition,  the  presence 
or  absence  of  specular  features  provides  immediate  con¬ 
straints  on  the  positions  of  the  viewer  and  light  sources 
relative  to  the  specular  surface.  Also,  as  we  will  show, 
the  properties  of  a  specularity  constrain  the  local  shape 
and  orientation  of  the  specular  surface. 

An  ability  to  understand  specular  features  is  valu¬ 
able  for  any  vision  system  which  is  required  to  analyze 


unages  of  shiny  objects.  This  work,  for  example,  began 
as  an  attempt  to  allow  ACRONYM  ;3j  to  reason  about 
specular  reflections  from  shiny  mechanical  parts  in  the 
ITA  project  (4|.  Images  of  these  parts  typically  contain 
large  specular  regions.  The  recognition  task  becomes 
considerably  easier  if  the  system  is  able  to  predict  the 
characteristics  of  these  specular  regions. 

In  this  paper  we  examine  what  information  can  be 
inferred  from  an  image  of  a  rough  shiny  surface  by  con¬ 
sidering  only  the  physics  of  specular  reflection.  Par¬ 
ticular  emphasis  is  placed  on  Ending  symbolic  quasi- 
invariant  relationships  which  will  hold  in  many  different 
situations  (c.g.  different  source,  viewer  configurations). 
In  contrast  to  many  intensity-based  vision  algorithms, 
our  relationships  arc  based  on  the  properties  of  a  rela¬ 
tively  large  number  of  pixels  in  an  image.  This  allows 
us  to  observe  predicted  features  and  infer  local  surface 
shape  even  in  noisy  intensity  images  or  in  cases  where 
available  specular  models  do  not  completely  character¬ 
ize  the  physics  of  specular  reflection. 

2.  Review  of  Previous  Work 

Researchers  in  computer  graphics  have  used  in¬ 
creasingly  realistic  specular  models.  Several  of  these 
models  will  be  discussed  ill  the  next  section.  In  com¬ 
puter  vision,  however,  relatively  few  attempts  have  been 
made  to  exploit  the  information  encoded  in  speculari- 
tics.  Ikciichi  [!)j  employs  the  photometric  stereo  method 
[15]  and  uses  a  distributed  light  source  to  determine  the 
orientation  of  patches  on  a  surface.  Crimson  [8]  uses 
Phong’s  specular  model  [  10]  to  examine  spccularitics 
from  two  views  in  order  to  improve  the  performance  of 
surface  interpolation.  Coleman  ami  Jain  [5]  use  four- 
source  photometric  stereo  to  identify  and  correct  for 
specular  reflection  components.  In  more  recent  work, 
Blake  [l|  assumes  smooth  surfaces  and  single  point  spec- 
ularilies  to  derive  equations  to  infer  surface  shape  using 
specular  stereo.  He  shows  that  the  same  equations  can 
be  used  to  predict  the  appearance  of  a  specularity  on 
a  smooth  surface  when  using  a  distributed  light  source. 
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Takai,  Kimura,  and  Sata  [13]  ilcscribe  a  model-based  vi¬ 
sion  system  which  recognises  objects  by  predicting  spec¬ 
ular  regions.  As  specular  models  and  insights  improve, 
we  expect  to  see  more  work  which  makes  use  of  the 
properties  of  specular  rcQcction. 

3.  Specular  Reflectance  Models 

Civcn  a  viewer,  a  surface  patch,  and  a  light  source, 
a  reflectance  model  quantifies  the  intensity  the  viewer 
will  perceive.  The  most  general  reflectance  models  rep¬ 
resent  the  perceived  intensity  I  as  a  sum  of  three  inde¬ 
pendent  rejection  components 

I  =  1*  +  Id  +  Is  (!)  - 

Here  t ,\  represents  the  ambient  reflection,  Id  represents 
diffuse  (Lambertian)  reflection,  and  Is  represents  spec¬ 
ular  rcflccliou.  In  this  paper  we  restrict  uur  attention 
to  the  fs  reflection  component. 

We  note  that  it  is  typically  very  easy  to  separate 
the  Is  reflection  component  from  the  lA  and  Id  reflec¬ 
tion  compoueuts  in  an  image.  There  arc  two  distinctive 
properties  of  specular  reflection.  First,  over  most  of  a 
surface  I  g  is  zero,  but  in  specular  regions  Ig  is  usually 
very  large  relative  to  lA  and  ID.  Secondly,  in  regions 
where  the  specular  component  is  nonscro,  lg  changes 
much  more  rapidly  than  either  lA  or  Id- 

Ileforc  discussing  the  various  specular  reflectance 
models,  we  introduce  the  reflection  geometry  (Figure 
1).  We  consider  a  viewer  looking  at  a  surface  point  P 
which  is  illuminated  by  a  point  light  source.  Define 

V  =  unit  vector  from  P  in  direction  of  viewer 
N  —  unit  surface  normal  at  P 
L  -  unit  vector  from  P  in  direction  of  source 
fl  =  - j  (unit  augul.tr  bisector  of  V  and  L) 

l|  V  +  *»||  _ 

or  =  cos ~'(N  ■  H)  (the  angle  between  N  and  H) 

$  =  coa-1(iV  • V )  (the  angle  between  N  and  V) 


Figure  1.  The  Ilcflcctiiin  Geometry 


Throughout  this  paper,  we  consider  only  illumina¬ 
tion  from  a  single  point  light  source.  In  principle,  we 
lose  no  generality  using  this  kind  of  an  approach  since  we 
can  ilcscribe  distributed  light  sources  as  arrays  of  point 
sources.  Thus  to  handle  situations  involving  distributed 
light  sources  we  only  need  to  integrate  the  cirecls  of  an 
equivalent  array  of  point  sources. 

The  simplest  specular  model  assumes  that  spccu- 
laritics  only  occur  where  the  angle  between  L  and  N 
equals  the  angle  between  iV  and  V  and  L,  .V,  and  V  all 
lie  in  the  same  plane.  This  corresponds  to  the  situation 
a  =  0  in  Figure  1.  Unless  the  surface  is  locally  Hat,  this 
model  predicts  that  specularities  will  only  he  observed 
at  isolated  points  on  a  surface.  A  few  experiments,  how¬ 
ever,  show  that  this  model  is  inadequate  for  most  real 
surfaces.  Not  only  are  observed  specular  features  usu¬ 
ally  larger  than  single  points,  but  highlights  often  occur 
in  places  which  arc  not  predicted  by  Ibis  model. 

An  empirical  model  for  specular  reflection  has  been 
developed  by  Phong  [10]  for  computer  graphics.  This 
model  represents  the  specular  component  of  reflection 
by  powers  of  the  cosine  of  the  angle  between  the  perfect 
specular  direction  and  the  line  of  sight.  Thus  Phong’s 
model  is  capable  of  predicting  specularities  which  ex¬ 
tend  beyond  a  single  pomt.  While  Phong’s  model  gives 
a  reasonable  first  approximation  which  is  useful  in  many 
practical  situations,  it  is  possible  to  develop  more  accu¬ 
rate  models  by  examining  the  physics  underlying  spec¬ 
ular  reflection. 

The  Tonancc-Sparrow  model  [It!,  developed  by 
physicists,  is  a  more  refined  model  of  specular  reflec¬ 
tion.  This  model  assumes  that  a  surface  is  composed 
of  small,  randomly  oriented,  mirror-like  facets.  Only 
facets  with  a  normal  in  the  direction  of  fl  contribute  to 
Is.  The  model  also  predicts  the  shadowing  and  masking 
of  facets  by  adjacent  facets  using  a  geometrical  attenu¬ 
ation  factor.  The  resulting  specular  model  is 


where 

F  =  Fresnel  coefficient 

D  -  facet  orientation  distribution  function 
G  =  geometrical  attenuation  factor 

We  will  analyze  the  rlfccts  of  each  factor  in  the  model 
in  the  next  few  paragraphs.  The  results  we  present  in 
this  paper  arc  derived  from  (2). 

The  Fresnel  coefficient  F  models  the  amount  of  light 
which  is  reflected  from  individual  facets.  In  general,  F 
depends  on  the  incidence  angle  and  physical  properties 
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of  llic  reflecting  surface.  Cook  and  Torrance  [C|  have 
shown  that  to  obtain  realistic  graphics  images,  F  must 
characterise  the  color  of  the  specularity.  For  metal  sur¬ 
faces  F  is  approximately  a  constant. 

The  distribution  function  D  describes  the  orienta¬ 
tion  of  the  micro  facets  relative  to  the  average  surface 
normal  ,V .  Olinu  [2j  and  Cook  and  Torrance  [6]  dis¬ 
cuss  various  distribution  functions.  In  agreement  with 
Torrance  and  Sparrow  we  use  the  Gaussian  distribution 
function  given  by 

D  =  Ke-la/m)'  (3) 

where  K  is  a  normalization  constant.  Thus  for  a  given 
a,  D  is  proportional  to  the  fraction  of  facets  oriented 
in  the  direction  H.  The  constant  m  indicates  surface 
roughness  and  is  proportional  to  the  standard  deviation 
of  the  Gaussian.  Small  values  of  m  describe  smooth 
surfaces  for  which  most  of  the  specular  reflection  is  con¬ 
centrated  in  a  single  direction.  Large  values  of  m  are 
used  to  describe  rougher  surfaces  with  large  differences 
in  orientation  between  nearby  facets.  These  rough  sur¬ 
faces  produce  specularities  which  are  spread  out  on  the 
reflecting  surface. 

The  expression  for  the  geometrical  attenuation  fac¬ 
tor  G  is  derived  by  Torrance  and  Sparrow  in  (l-t|.  They 
assume  that  each  specular  facet  makes  up  one  side  of  a 
symmetric  v-groove  cavity.  From  this  assumption,  they 
examine  the  various  possible  facet  configurations  which 
correspond  to  shadowing  or  masking.  They  quantify  the 
geometrical  attenuation  factor  as 


approximation  for  most  specularly  reflecting  surfaces. 
We  can  further  simplify  (2)  by  observing  that  except 
for  a  small  range  of  angles  near  grazing  incidence,  the 
value  of  G  is  unity.  We  will  discuss  this  result  and  the 
exceptional  cases  later.  Hence  the  form  of  (2)  used  to 
determine  local  surface  properties  is 


Referring  again  to  the  geometry  of  Figure  1,  wc  as¬ 
sume  that  the  viewer  and  light  source  arc  distant  relative 
to  the  surface.  Therefore  V  and  L  arc  essentially  con¬ 
stant  and  hence  their  angular  bisector  II  is  essentially 
constant.  Wc  assume  that  the  positions  of  the  viewer 
and  light  source  are  known.  Finally,  since  the  distance 
from  the  viewer  to  the  surface  is  large,  wc  can  approx¬ 
imate  the  perspective  projection  of  the  imaging  device 
wiLli  an  orthographic  projection. 

Doubly  Curved  Surfaces 

For  a  surface  which  is  doubly  curved  at  a  specu¬ 
larity  (i.e.  both  principal  curvatures  are  different  from 
zero)  wc  will  be  able  to  locate  a  single  point  P,>  of  max¬ 
imum  intensity  in  the  image  of  the  specularity.  From 
(">)  wc  see  that  this  point  corresponds  to  llic  local  sur¬ 
face  orientation  /V  -II  (i.e.  a  =  0).  Given  a  doubly 
curved  surface  where  II  is  known,  wc  can  very  quickly 
determine  the  surface  orientation  at  Pu. 

Figure  2  shows  a  typical  specular  image  generated 
about  an  elliptic  point  on  a  surface. 


* 


CaJ i, W •  ?■> , 2JJU3AJd \  (4) 

l  (V  //)  (V  It)  I  {r 

Wc  will  show  that  in  applications  it  is  often  possible  to 
use  a  simpler  expression  for  G. 

As  0  increases  from  0  to  the  viewer  gradually 
sees  a  larger  part  of  the  reflecting  surface  in  a  unit  area 
in  the  view  plane.  Therefore,  as  0  gets  larger,  there  are 
correspondingly  more  surface  facets  which  contribute  to 
the  intensity  perceived  by  the  viewer,  Wc  take  this  phe¬ 
nomenon  into  account  in  (2)  by  dividing  by  N  ■  V , 

4.  Inferring  Surface  Properties 

In  this  section,  wc  demonstrate  how  wc  can  use  (2) 
to  determine  local  surface  properties  from  specularities. 
In  almost  all  situations  we  do  not  rt'i|iiirc  the  full  gen¬ 
erality  of  (2)  to  infer  these  local  properties.  Our  first 
assumption  is  that  1*'  is  constant.  This  is  a  very  good 


Figure  2. 

Specular  Intensities  on  a  doubly  curved  surface 


The  dosed  curves  arc  image  curves  of  constant  intensity. 
Pd  corresponds  to  a  =  0.  As  predicted  by  (5),  intensity 
decreases  as  we  move  away  from  Ptt.  Now  suppose  we 
examine  a  straight  segment  S  in  the  image  which  inter¬ 
sects  I\ ,  and  which  begins  and  tern  inates  on  a  constant 
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intensity  curve  C.  Let  the  measured  intensity  at  Pit  be 
f„  and  let  the  measured  intensity  on  C  be  /».  Since  the 
exponential  factor  in  (5)  will  change  very  fast  relative 
to  the  change  in  (N  ■  V),  we  can  consider  [N  ■  1?)  to 
be  constant  on  S.  DcGnc  da  to  be  the  chaugc  in  a  as 
we  move  from  the  surface  point  imaging  to  l\>  to  the 
surface  point  imaging  onto  C  along  S. 

If  we  let  K'  =  *  then  from  (5)  we  have 

/„  =  K\  h  =  K'e-(,,/m)’  (0) 

whidi  give  us 


da  =  m  Vln  /«  —  In  / 1  (7) 

To  determine  the  surface  curvature  along  S  we  need 
to  compute  the  arc  length  of  the  curve  on  the  surface 
which  generated  S  in  the  image.  This  will  depend  on  V. 
We  do  this  by  introducing  an  x,y,x  coordinate  system 
such  that  the  surface  curve  S'  imaging  to  S  lies  in  the 
x-y  plane  (figure  3).  Denote  liy  P't  the  point  imaging 
to  /’,|  mid  place  /*',  .at  the  origin,  further  arrange  the 
coordinate  system  so  that  fl  is  parallel  to  the  y  axis. 
Let  V'  be  the  projection  of  V  onto  the  X-y  plane. 


Figure  3.  The  Surface  Geometry 


Using  (7)  and  (8)  we  can  estimate  the  curvature  ic  on  S' 
at  Pq  as 


Note  that  here  wc  are  using  the  fact  that  since  the  length 
of  S'  is  small  the  surface  normal  at  any  point  on  S'  lies 
approximately  in  the  same  plane  as  S'  and  II  in  figure 
3. 

For  any  segment  like  S  which  intersects  Pu  and  be¬ 
gins  and  terminates  on  C  wc  can  compute  a  correspond¬ 
ing  value  of  k.  If  wc  examine  these  line  segments  for  ev¬ 
ery  direction  in  the  image,  then  on  the  tangent  plane  to 
the  surface  at  l\\  we  will  he  examining  the  correspond¬ 
ing  line  segments  in  every  direction  through  f V* - 

Consequently,  on  the  surface  wc  will  compute  <c  for  all 
curves  formed  by  intersecting  the  surface  with  planes 
containing  N  and  /,  (for  i=l,...,n).  The  largest  and 
smallest  computed  values  of  k  will  give  the  principal 
curvatures  of  the  surface  at  [12].  Therefore  we  can 
determine  the  principle  curvatures  and  the  principle  di¬ 
rections  at  Pq. 


If  one  principal  curvature  of  a  surface  is  zero  in 
a  specular  region  wc  will  not  be  able  to  immediately 
infer  the  local  orientation  as  wc  did  for  a  doubly  curved 
surface.  To  understand  why,  consider  figure  4.  Figure  1 
shows  a  viewer  looking  at  a  tilled  cylinder.  To  make  the 
example  concrete,  assume  that  L  is  such  that  II  —  V . 


Singly  Curved  Surfaces 


Since  the  specularity  will  only  bo  observable  for  a 
small  range  of  a,  we  can  approximate  the  arc  length  of 
S'  by  the  length  of  its  projection  onto  the  tangent  plane 
to  the  surface  at  If  Is  denotes  the  arc  length  of  S' 
and  If  denotes  the  length  of  S  in  the  image  then  letting 
O'  he  the  angle  between  V'  and  the  y  axis  we  have 


Is  - 


h 

cos  O' 


(8). 


Figure  4.  Viewer  Observing  a  Tilted  Cylinder 


For  this  configuration  there  will  be  no  point  on  the  sur¬ 
face  for  which  a  =  0  (recall  that  ll  is  essentially  con¬ 
stant),  yet  we  will  still  observe  a  specularity  in  the  image 
if  at  some  point  a  is  small  enough  to  give  a  significant 
value  for  Is  in  (5).  The  lines  of  constant  Is  in  the  im¬ 
age  appear  as  in  Figure  5.  Here  Co  corresponds  to  the 


smallest  a  and  therefore  the  largest  specular  intensity. 
As  predicted  by  the  model,  Is  decreases  as  we  move 
away  from  Cq. 


Figure  5.  Lines  of  Constant  l,s  for  a  Cylinder 

We  observe  that  it  is  typically  easy  to  detect  the 
fact  that  a  surface  is  singly  curved  at  a  specularity.  This 
is  because  we  will  observe  a  tine  of  maximum  intensity 
(along  the  line  of  zero  curvature)  instead  of  the  point 
maximum  we  observe  for  the  doubly  curved  case. 

Next  we  examine  how  we  can  infer  curvature  and 
orientation  from  an  image  of  a  singly  curved  surface.  We 
cannot  simply  apply  the  analysis  for  the  doubly  curved 
case  since  in  general  we  do  not  know  a  at  surface  points 
on  the  line  of  maximum  specular  intensity.  In  Figure 
3  it  is  reasonable  to  assume  that  a  =  0  at  P't.  For 
the  singly  curved  ease,  however,  the  relationship  will  be 
more  complicated.  Modify  the  geometry  of  Figure  3  so 

that  ft  lies  in  the  y-i  plane  and  makes  an  angle  0  with 
the  x-y  plane.  The  normal  to  S'  at  is  still  considered 
to  be  parallel  to  the  y  axis.  If  the  curvature  of  S'  at  P'Q 
is  l/r  then  locally  we  have 

*  =  00) 

II  -  (0,tos<£,  sin  0)  (11) 


a(z)  =  cos  ~ 1  ( — —  s/ t 3  -  x1)  (12). 

This  expression  allows  us  to  predict  the  appearance  of 
Is  on  a  singly  curved  surface  as  a  function  of  curvature. 
Figure  6  shows  how  Is  changes  for  a  cylinder  of  fixed 
curvature  us  we  change  t>.  It  is  worth  noting  that  both 
the  magnitude  and  shape  of  Is  change  as  0  increases. 


rtxsu 


Figure  G.  /*•  for  different  values  of 


Pianos 

For  a  planar  surface,  ;V  is  constant.  Hence  recalling 
onr  basic  assumptions,  Is  is  constant  across  a  plane.  If 
the  plauc  is  oriented  such  that  a  is  small  enough,  then  a 
viewer  will  perceive  elevated  intensity  rcllcctcd  from  the 
plane.  As  with  the  singly  curved  surface,  the  magnitude 
of  the  perceived  intensity  will  depend  on  a.  If  a  is  not 
sufficiently  small,  then  Is  will  be  scro  at  all  points  on 
the  plane.  These  observations  provide  us  with  two  useful 
pieces  of  information: 

1.  Shiny  surfaces  which  don’t  generate  spccularities 
over  a  range  of  orientations  arc  probably  planar. 

2.  Surfaces  which  produce  a  specularity  of  constant  ' 
intensity  over  a  2-D  region  in  the  image  are  locally 
planar. 

S.  Predicting  G 

In  the  previous  analysis  we  have  used  the  Tact  that 
over  most  viewer,  source,  surface  configurations  the  ge¬ 
ometrical  attenuation  factor  G  of  (-1)  will  have  the  con¬ 
stant  value  1.  For  large  angles  of  incidence,  however, 
the  character  of  0  changes  remarkably.  In  particular, 
for  large  angles  of  incidence  (glancing  incidence)  we  see 
that 

1.  G  can  become  as  large  as  10. 

2.  G  causes  a  shift  in  the  peak  of  the  specular  profile 
toward  larger  angles  of  incidence. 

3.  G  causes  the  specular  profile  In  he  unsyminclric  as 
a  function  of  a. 


Il  is  not  surprising  that  when  these  excels  arc  present  in 
an  image,  they  arc  rather  easy  to  delect,  For  this  reason, 
it  is  proliahly  profitable  to  make  qualitative  predictions 
about  G  in  applications  where  large  angles  of  incidence 
are  possible. 

0.  The  Laboratory  Setup 

A  laboratory  arrangement  has  been  set  tip  to  test 
the  derived  relationships  (Figure  7).  In  this  section  of 
the  paper,  the  laboratory  setup  is  described.  In  Section 
7,  we  share  insight  gained  about  how  to  best  use  the 
input  image  data  to  infer  surface  properties  from  spec- 
tilarilics  in  a  working  system.  Experimental  results  are 
presented  in  Section  8. 


Figure  7.  The  Specularity  Lab 


To  insure  accurate  measurements,  the  experiments 
are  conducted  on  a  4x6  foot  optical  table.  High  preci¬ 
sion  rotation  and  translation  stages  arc  used  to  position 
the  objects  being  viewed.  A  halogen  light  source  with 
a  5  mm  wide  filament  is  placed  20  feet  from  the  object 
surface  to  approximate  a  point  source.  Monochromatic 
image  data  is  obtained  using  a  video  camera  and  an  im¬ 
age  digitiser.  A  210  mm  lens  is  used  with  the  video 
camera  to  obtain  high  resolution  across  the  specularity. 
The  resulting  images  are  in  the  form  of  25Gx25G  arrays  of 
pixels.  Each  pixel  has  eight  bits  of  gray  levc!  resolution. 
A  precise  positiouing  device  has  been  built  to  position 
the  camera  relative  to  the  surface.  Camera-object  dis¬ 
tances  of  at  least  24  inches  are  enforced  to  insure  that 
the  assumed  distant  object  condition  is  met.  Using  this 
setnp,  it  is  possible  to  obtain  more  than  40  pixels  across 
a  specular  feature  which  is  less  than  a  centimeter  wide 
on  the  surface. 


Aluminum  cylinders  of  diameter  3.5,  2.5,  1.5,  and 
0.75  inches  arc  used  to  test  the  predicted  relationships 
(Figure  8).  The  cylinders  have  been  carefully  machined 
to  achieve  uniformity  of  surface  roughness  on  individual 
cylinders  and  between  diirurcut  cylinders.  The  length  of 
each  cylinder  is  divided  into  1  sections  of  diirercnt  mea¬ 
sured  roughness.  From  this  we  are  able  to  study  the 
elTect  of  varying  surface  roughness  ou  images  of  spccu- 
larities.  In  the  future  we  plan  to  experiment  with  dif¬ 
ferent  kinds  of  specular  surfaces  and  also  with  surfaces 
which  are  doubly  curved. 


Figure  8.  Experimental  Specular  Surfaces 


7.  Interpreting  Real  Images 

In  this  section  we  discuss  practical  considerations 
related  to  using  the  results  from  Section  4  to  infer  sur¬ 
face  properties  from  real  images.  For  the  Orst  set  of  ex¬ 
periments,  each  cylinder  is  orirnlcd  such  that  a  -  0  on 
the  line  of  maximum  perceived  intensity.  For  this  spe¬ 
cial  ease,  the  doubly  curved  surface  analysis  applies  to 
our  singly  curved  surfaces  (cylinders).  Figure  9  shows 
a  typical  image  obtained  using  this  configuration.  As 


Figure  9.  A  Specular  Image 
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previously  discussed,  the  specularitics  arc  easily  located 
in  an  image.  It  is  reasonable  to  assume  that  [I  A  +  Iq) 
is  constant  in  the  small  neighborhood  of  the  specularity. 

Thus  we  compute  Is  by  subtracting  a  constant  from  the 
pixel  values  on  the  spccul.irity  in  an  input  image.  Ig  is 
set  to  zero  elsewhere.  Figure  10  shows  a  plot  of  Ig  along 
a  horisontal  row  of  pixels  taken  from  Figure  9  after  the  '* 

subtraction  of  (IA  +  Ip). 


Figure  10.  Plot  of  [s 


Computing  the  Curvature 

Suppose  now  that  we  want  to  make  the  curvature 
computation  described  in  Section  4  on  the  horisontal  im¬ 
age  line  plotted  in  Figure  10.  The  problem  is  to  select 
an  appropriate  pixel  segment  S  in  this  image  row  which 
intersects  the  line  of  maximum  Is  and  begins  and  termi¬ 
nates  on  pixels  of  equal  specular  intensity.  An  equivalent 
problem  is  to  draw  a  horizontal  liue  in  Figure  10  which 
intersects  the  Is  curve  at  2  points  of  equal  specular  in¬ 
tensity.  In  principle,  any  image  segment  which  satisfies 
the  stated  conditions  will  suflice.  In  practice,  however, 
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Figure  11.  S  Chosen  Too  High. 
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Figure  12.  S  Chosen  Too  Low 


some  choices  for  S  arc  better  than  others.  Figure  11 
shows  the  case  where  S  is  chosen  to  be  only  in  the  high 
intensity  part  of  the  Is  curve.  For  this  case  S  will  only 
be  a  few  pixels  long  and  any  error  in  the  measurement 
will  cause  a  large  relative  error  in  |S|.  Figure  12  depicts 
a  different  kind  of  problem.  Here  S  is  drawn  to  connect 
two  pixels  of  small  specular  intensity.  Now  S  is  many 
pixels  long,  but  choosing  the  terminating  points  is  diffi¬ 
cult,  if  not  impossible.  This  is  because  Is  changes  only 
slightly  from  pixel  to  pixel  on  the  fringes  of  the  specu¬ 
lar  profile,  lienee  for  this  case  there  will  probably  be  a 
large  spat.al  range  of  pixels  which  arc  reasonable  termi¬ 
nating  points  for  S.  lienee  by  choosing  one  of  these,  we 
risk  introducing  a  large  error  in  |i'|. 


The  solution,  of  course,  is  to  have  S  begin  and 
terminate  at  pixels  of  intermediate  specular  intensity. 
Since  Is  is  approximately  Gaussian,  we  can  determine 
a  Gaussian  fit  for  Is  and  compute  its  standard  devia¬ 
tion  i7.  Let  ii  be  the  pixel  of  maximum  specular  intensity 
(the  mean  of  the  Gaussian)  and  let  T  be  the  symmetric 
about  n  pixel  interval 


T  =  \n  —  ui,  n  +  i 


(13) 


over  which  S  is  defined.  Consistent  with  the  heuristic 
arguments  given  above,  experiments  have  shown  (see 
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Section  8)  that  an  accurate  curvature  computation  will 
result  if  we  have 

a  <  in  <  2a  (14) 

By  imposing  this  restriction  on  T,  we  guarantee 
that  we  will  choose  an  S  which  avoids  cither  of  the  pre¬ 
viously  discussed  pitfalls.  We  may  improve  our  accu¬ 
racy  hy  performing  the  compulations  of  Section  4  for 
several  different  S  segments  for  which  w  satisfies  (14). 
The  curvature  ic  can  then  he  obtained  hy  averaging  the 
curvatures  computed  for  the  different  segments. 

Truncation  Enacts 

Since  specalarities  arc  usually  the  brightest  features 
in  unages,  specular  intensities  are  often  too  large  to  be 
represented  in  the  number  of  bits  per  pixel  allowed  by 
the  digitising  hardware.  If  this  is  the  ease,  the  spec¬ 
ularity  is  said  to  lie  truncated.  Figure  13  shows  I  for 
a  truncated  specularity.  The  obvious  way  to  deal  with 
tins  situation  'is  to  avoid  it.  One  avoidance  technique 
is  to  take  multiple  images  in  which  differing  amounts 
of  light  arc  allowed  to  pass  through  the  lens.  This  can 
be  achieved  cither  by  adjusting  the  lens  aperture  or  by 
using  filters.  Another  possible  solution  is  to  control  the 
illumination  to  eliminate  the  possibility  of  truncation. 


Figure  13.  A  Truncated  Specularity 


If  inferences  must  be  made  from  a  single  image, 
then  it  is  arguably  better  to  allow  truncation  to  occur. 
In  the  case  where  input  images  have  eight  bits  per  pixel, 
intensities  will  range  from  0  to  255.  In  many  applica¬ 
tions  it  is  possible  to  weaken  the  Incident  illumination 
so  that  no  truncation  occurs.  In  doing  (his,  however,  we 


cause  pixels  on  the  Is  curve  which  previously  had  sig¬ 
nificant  specular  intensities  (on  the  truncated  specular 
feature)  to  have  negligible  specular  intensities.  The  net 
effect  of  eliminating  truncation  is  to  decrease  the  width 
of  the  specular  feature  and  make  width  measurements 
more  susceptible  to  small  errors. 

8.  Experimental  Result* 

The  technique  described  in  Section  1  has  been  ap¬ 
plied  to  the  task  of  determining  the  curvature  of  each 
of  the  four  cylindrical  surfaces.  Figure  14  shows  the  I 
profile  for  each  of  the  four  surfaces  cj,  cj,  c-,  and  c4 
taken  along  the  line  of  maximum  curvature.  Note  that 
we  allow  truncation.  Table  I  displays  the  results  of  the 
experiments.  For  these  measurements,  w  (sec  Section 
7)  is  taken  to  he  1.85<r.  Wc  have  observed  that  for  the 
larger  (less  curved)  cylinders  c(  and  c>  the  computed 
curvature  varies  by  less  than  10%  as  wc  let  w  vary  in 
the  interval  a  <  te  <  2a.  The  reason  for  this  desir¬ 
able  behavior  is  the  fact  that  wc  arc  able  to  measure 
many  pixels  across  spccuiaritics  on  these  cylinders.  On 
the  other  hand,  if  we  attempt  to  measure  the  specular 
widths  for  the  smaller  cylinders  C]  and  c2  near  the  spec- 


rums 

Figure  14.  I  for  Four  Different  Surface  Curvatures 
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Table  1.  Curvature  Computations  for  the  Four  Surfaces 
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ular  intensity  peaks,  it  is  possible  to  get  errors  larger 
Ilian  15%  in  tlic  coinpiileil  curvature.  This  is  because 
near  these  peaks,  we  arc  only  able  to  measure  a  few 
pixels  across  the  spccuiarilics.  Therefore  for  high  cur¬ 
vature  surfaces,  it  is  advisable  to  measure  the  specular 
widths  as  near  to  the  base  of  the  curve  ns  possible  with¬ 
out  falling  victim  to  the  problem  discussed  in  Section  7. 
As  Ls  evident  from  Table  I,  the  more  pixels  which  can  be 
measured  across  a  specular  feature,  the  more  accurately 
we  can  compute  the  curvature.  lienee  one  immediate 

way  to  improve  results  is  to  digitize  higher  resolution 
images. 

An  interesting  observation  can  be  made  from  Fig¬ 
ure  M.  The  specular  model  (2)  described  in  Section  3, 
predicts  that  each  of  the  four  surfaces  should  generate 
the  same  maxiniiiiit  value  for  f.s  when  a  —  0.  This  pre¬ 
diction  is  intuitively  appealing,  since  it  seems  that  if  we 
examine  a  small  enough  patch  on  any  of  the  surfaces 
that  patch  should  be  approximately  planar.  Hut  a  cur¬ 
sory  glance  at  Figure  13  seems  to  imply  that  a  highly 
curved  surface  produces  a  smaller  maximum  value  for  [$ 
than  a  Uniter  surface.  The  model,  however,  is  correct. 
The  problem  is  that  for  the  highly  curved  surfaces  we 

are  unable  to  shrink  a  pixel  down  to  where  the  surface 
area  it  images  is  approximately  planar.  Even  within  the 
single  maximum  pixel,  a  is  changing  and  cannot  be  con¬ 
sidered  to  be  constant  zero.  Hence  the  intensity  value  at 
the  maximum  pixel  will  be  some  kind  of  average  spec¬ 
ular  intensity  over  a  range  of  a  and  will  not  give  us 
the  true  maximum  f.s  •  Thus  it  is  understandable  that 
maximum  measured  intensity  seems  to  increase  as  sur¬ 
face  curvature  decreases.  It  follows  that  to  compute  the 
maximum  specular  intensity  in  applications,  we  should 
use  a  surface  of  small  curvature. 

0.  Summary  and  Implications 

Understanding  specular  reflections  is  important  for 
any  computer  vision  system  which  must  interpret  im¬ 
ages  of  shiny  objects.  Using  a  model  developed  by  op¬ 
tics  researchers,  w<  have  shown  that  the  local  orientation 
and  principal  curvatures  of  a  specular  surface  can  be  de¬ 
termined  by  examining  image  intensities  on  a  specular¬ 
ity.  Unlike  previous  work,  our  derivations  have  included 
the  circcln  of  surface  roughness  and  microstructure  on 
the  appearance  of  specular  features. 

A  laboratory  setup  lias  been  described  which  allows 
us  to  test  our  theoretical  relationships.  Very  good  re¬ 
sults  have  been  achieved  despite  the  fact  that  the  high 
intensity  and  small  spatial  ext  it  of  spccuiarilics  make 
measurements  difficult.  Practical  issues  related  to  the 
implementation  of  our  analytical  results  have  been  dis¬ 
cussed.  These  issues  have  been  addressed  by  the  presen¬ 
tation  of  tested  methods  which  successfully  apply  our 


results  to  the  problem  of  interpreting  real  images. 

The  ability  to  predict  intensity  patch  features  such 
as  spcctilarities  opens  up  interesting  possibilities  for 
model-based  vision.  Previous  iiiodci-based  vision  sys¬ 
tems  have  restricted  their  predictions  to  the  shapes  of 
image  contours  which  will  be  observed  for  a  given  model. 
An  ability  to  predict  intensity  patch  features  will  signif¬ 
icantly  enhance  the  capabilities  of  a  model-based  vision 
system.  Clearly  it  is  advantageous  to  be  able  to  make 
stronger  predictions  about  an  image  by  using  additional 
information  about  the  imaging  process.  A  perhaps  more 
important  advantage  of  predicting  intensity  patches  is 

that  this  prediction  can  provide  strong  guidance  to  low 
level  intensity  based  visual  processes  such  as  edge  de¬ 
tection.  By  making  predictions  about  the  appearance 
of  intensity  patch  features  we  can  hope  to  further  unify 
the  goals  of  the  low  level  and  high  level  mechanisms  of 
a  model  based  vision  system. 

10.  Future  Work 

One  plan  for  future  work  is  to  continue  conducting 
experiments  and  working  out  details  associated  with  in¬ 
ferring  local  surface  properties  from  spccuiarilics.  In 
the  near  future  experiments  are  planned  to  study  the 
effects  of  different  specular  materials,  different  kinds  of 
roughness,  and  different  surface  orientations.  We  also 
plan  to  experiment  with  doubly  curved  surfaces  and  to 
develop  a  model  which  predicts  the  combined  effects  of 
rough  surfaces  and  distributed  light  sources.  It  is  ex¬ 
pected  that  as  experiments  and  analysis  continue,  we 
will  be  able  to  develop  more  refined  algorithms  for  us¬ 
ing  spccularitics  to  understand  images. 

Another  plan  for  future  work  is  to  formulate  a  gen¬ 
eral  framework  which  will  allow  the  qualitative  predic¬ 
tion  of  the  structure  of  intensity  patches  for  a  model. 
The  primary  challenge  will  be  to  isolate  singularities  in 
the  structure  of  the  intensity  patches.  As  an  example,  a 
singularity  occurs  when  we  rotate  a  singly  curved  object 
from  an  orientation  where  a  specularity  is  visible  to  an 
orientation  where  the  specularity  disappears.  An  ability 
to  predict  the  structure  and  singularities  of  image  inten¬ 
sity  patches  will  open  up  significant  new  possibilities  for 
model  based  vision  systems. 
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APPENDIX  D 


On  the  Design  of  a  Geometric  Modeling  System* 
Pang-Chich  Chen 


Introduction: 

The  goal  of  this  project  is  to  provide  means  of  building  up  complex  geometric  objects 
using^rimitives  and  set  operators  such  as  union,  intersection,  and  set  difference.  To  achieve 
this  goal,  it  is  necessary  to  find  a  computer  representation  that  can  model  the  objects 
efficiently  both  in  time  and  space  to  an  arbitrary  degree  of  accuracy,  it  is  also  necessary  to 
devise  efficient  algorithms  to  manipulate  the  representations  so  that  the  set  operations  can 
be  realized.  Certainly  there  are  many  different  ways  to  approach  the  problem,  depending 
upon  the  types  of  primitives  one  wishes  to  consider.  For  our  purpose,  restrictions  on  the 
class  of  primitives  should  be  minimal.  With  these  specifications  in  mind,  we  proceed  to 
discuss  the  topics  of  primitives,  data  structures,  and  algorithms. 

Primitives: 

Let  z  and  u  stand  for  vectors  in  world  and  object  space.  To  avoid  complications  we 
shall  work  with  orthogonal  coordinate  spaces  only.  For  each  primitive  P,  we  shall  stipulate 
that  the  mapping  from  object  space  u  to  world  space  z  can  be  represented  analytically  in 
t.hc  form  x  —  M(u).  Furthermore,  the  surface  of  each  primitive  shall  be  piece-wise  planar, 
with  each  piece  constant  in  one  object  coordinate. 

As  an  example,  consider  a  cylinder  as  a  primitive.  Let  z  and  u  stand  for  the  Cartesian 
coordinates  (z,  y,  z)  and  the  cylindrical  coordinates  ( r,0,z ).  The  mapping  could  be 

(z,t/,z)  =  (r  cos  0,  r  sin  0,z),  where 

r  e  [O,r0j,  6  €  [0,2tt),  z  €  [0,zo|- 

The  surface  of  this  primitive  consists  of  three  pieces,  corresponding  to  r  =  r<j,  z  =  0,  and 
z  =  zo- 

It  is  in  general  impossible  to  compute  M~l .  So  to  represent  the  surface  in  world 
space  we  shall  use  a  subdivision  of  the  surface  in  object  space  as  an  approximation.  Of 
course,  liner  subdivision  leads  to  closer  approximation,  ami  such  refinement  process  could 
be  performed  on-line  to  meet  proper  specifications.  To  formalize  the  subdivision  process, 
let  us  introduce  some  terminology. 

1.  A  vertex  v  is  a  point  on  the  surface  with  its  object  coordinates  known. 

2.  An  edge  e  is  a  double-entity  with  two  vertices  as  its  endpoints.  In  both  object  and 
world  space,  it  represents  the  straight  line  segment  between  the  two  vertices.  Note  that 

*  This  work  is  supported  in  part  by  a  fellowship  from  the  Hertz  Foundation 
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the  two  representations  arc  not  necessarily  equivalent,  because  a  straight  line  in  the  object 
space  may  not  map  to  a  straight  line  in  the  world  space. 

3.  A  face  /  is,  like  an  edge,  a  double-entity.  It  has  a  boundary  composed  of  edges  and 
vertices.  In  both  object  and  world  space,  it  represents  the  planar  surfaces  generated  by 
the  surrounding  edges  and  a  center  point.  The  center  point  in  object  space  is  the  centroid 
of  the  surrounding  vertices.  Its  world  space  coordinates  is  simply  the  image  of  the  object 
space  coordinates  under  M.  Thus,  /  is  a  set  of  triangles  in  world  space.  In  object  space, 
/  is  a  set  of  coplanar  triangles.  As  a  side  note,  the  convexity  of  /  in  object  space  will  be 
maintained  throughout  the  program. 

4.  A  net  N  =  ( V ’,  E ,  F)  for  a  surface  dP  is  a  subdivision  of  dP.  V ,  E,  and  F  are  the 
vertex,  edge,  and  face  set,  resp.  Note  that  N  represents  two  different  surfaces  Na  and  Nw, 
piece- wise  planar  in  object  and  world  space,  resp.  N0  corresponds  to  the  exact  surface  dP, 
while  Nw  is  only  an  approximation. 

5.  A  rope  R  =  (V,  E)  for  a  curve  L  is  a  subdivision  of  L.  It  is  merely  a  one-dimensional 
analog  of  a  net. 

We  shall  use  a  net  N  in  world  space  to  model  the  actual  object  surface.  Similarly,  the 
curve  of  intersection  between  two  objects  shall  be  modeled  by  a  rope  R.  The  fitness  of  the 
net  approximation  can  be  measured  by  the  value 

max  min  Ip  — 9I, 

|7€W. -few. 

evaluated  in  world  space.  However,  because  this  value  may  not  be  easily  computable,  we 
employ  an  estimated  measure,  the  tightness  r.  The  better  the  approximation,  the  smaller 
the  tightness  value.  By  definition, 

t(N)  —  max  f(d), 

t€/€N 

with  t  a  planar  piece  of  face  /  in  N.  Let  a, 6, c  be  the  three  vertices  defining  t,  and  n  be  the 
normal  function  so  that  n(a)  is  the  normal  vector  at  a.  Denote  A(l)  the  triangular  area  of 
A(a,  6,c)  in  world  space.  Also  denote  the  pair-wise  function  ©(c)  the  angle  between  n(a ) 
and  n(6).  We  define 

f(t)  =  A(t)  *^0(a)2. 

a 

This  formula  can  be  derived  through  a  scries  of  approximation.  Roughly,  f(t)  represents 
the  extremal  distance  between  A(«,6,c)  and  a  fitting  spherical  surface  with  solid  angle 
defined  by  the  three  normals.  Thus,  intuitively,  we  arc  replacing  the  exact  surface  N0  by 
spherical  surface  patches. 

To  illustrate  further,  let  us  derive  a  plausible  formula  for  f  in  the  one-dimensional 
case.  Given  two  points  in  space  and  a  curve  going  through  them,  we  wish  to  determine 
the  fitness  of  the  approximating  straight  line  segment.  Rather  than  using  the  actual  curve 
for  comparison,  we  use  a  circular  arc  instead.  Let  0  be  the  angle  between  the  two  normals 
at  the  two  points.  Let  d  be  the  distance  between  the  two  points,  and  r  be  the  radius  of 
the  circular  arc.  We  now  make  the  assumptions  that  the  actual  curve  docs  not  twist  too 
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much  between  the  two  points  and  that  Q  is  sufficiently  small.  We  then  have  the  following 
approximate  relations. 

d  ~  2rsin(0/2)  ~  r9, 
f  far  —  rcos(0/2)  «  r02/ 4 
=>  f  «  r0(d/r)/4  =  0d/4 

Thus,  within  a  constant  factor,  we  can  define  f  =  0d. 

The  algorithm  for  refinement  ,  i.e.  the  process  of  reaching  a  sufficiently  fine  subdivi¬ 
sion,  is  now  obvious.  We  simply  subdivide  the  faces  in  the  object  space  until  the  tightness 
of  the  net  becomes  smaller  than  some  specified  value  T.  A  plane  ut-  =  constant  is  used 
to  split  the  face  into  two  parts.  The  direction  and  the  constant  are  determined  from  the 
original  r  value  so  that  the  resulting  r  values  would  be  decreased  in  a  favorable  way.  With 
proper  initialization  we  see  that  the  faces  will  always  remain  convex  in  object  space  under 
the  splitting  process.  Furthermore,  by  the  property  of  r,  the  refining  procedure  will  always 
terminate  as  long  as  T  is  positive. 

To  illustrate  the  refinement  process,  we  have  the  orthographic  projections  of  the  nets 
representing  a  cylinder  and  a  sphere.  In  figure  1,  we  have  the  initial  net  representing  a 
cylinder  of  radius  50  and  height  80.  After  refinement  with  T  =  100  we  have  the  net  in 
figure  2.  Figure  3  and  4  show  the  similar  view  of  a  sphere  with  radius  50. 

An  object  can  be  described  by  the  specification  of  the  surface  and  the  volume  of  space 
it  occupies.  Using  the  refinement  algorithm  we  can  construct  a  sufficiently  tight  net  to 
model  the  object’s  surface.  To  represent  the  volume  on  the  other  hand,  we  shall  use  an 
oct-trcc  data  structure.  Now  wc  discuss  the  data  structures  used  in  the  system. 

Data  Structures: 

To  implement  the  net  structure  each  primitive  has  access  to  doubly  linked  lists  of 
faces  and  edges.  Each  face  consists  of  a  circular  list  of  vedges,  with  each  vedge  composed 
of  a  vertex  and  a  edge.  The  vedges,  when  accessed  in  the  forward  manner,  form  a  CCW 
order  with  respect  to  the  outside  of  the  surface  containing  the  face.  By  definition,  each 
face  belongs  to  one  particular  primitive  and  can  have  one  of  the  six  possible  orientations 
(three  directions  with  parity  in  each  direction)  in  object  space. 

Each  edge  consists  of  two  vertices  as  its  endpoints.  It  also  has  two  neighbors  which 
consist  of  two  faces  or  one  face  and  one  edge.  The  neighbor  of  an  edge  can  be  another 
edge  belonging  to  a  different  primitive.  H  is  this  property  that  allows  linkage  of  different 
primitives  to  form  complex  objects.  The  two  edges  that  arc  neighbors  of  each  other  together 
model  a  piece  of  intersection  curve  between  two  primitives. 

Besides  the  object  and  world  coordinates,  a  vertex  also  contains  a  pointer  to  an  ordered 
list  of  fudges  describing  its  neighborhood.  A  fedge  consists  usually  of  an  edge  and  a 
face.  The  fedges  form  a  CCW  order  with  respect  to  the  vertex  as  viewed  from  above  the 
surface.  The  fedge  list  contains  only  neighboring  elements  belonging  to  the  same  primitive 
containing  the  vertex.  Thus,  a  fedge  list  may  not  completely  describe  the  neighborhood  of 
a  point.  However,  at  the  end  of  the  list  where  a  face  is  usually  expected,  another  vertex 
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belonging  to  a  different  primitive  may  be  in  place  instead.  The  set  of  vertices  linked  up 
as  above  would  represent  an  intersection  point  that  has  the  various  object  coordinates  as 
well  as  the  common  world  coordinates. 

We  use  an  oct-tree  to  model  the  volume  of  an  object.  Each  cell  c  of  a  tree  is  either  a 
node  or  a  leaf.  For  simplicity  we  use  a  sphere  to  represent  each  cell.  Note  that  the  spheres 
would  have  to  overlap  and  thus  cause  some  wastes  in  space.  The  advantages  of  using 
spheres  instead  of  cuboids  or  other  types  of  volume  are  implementation  simplicity  and 
time  efficiency.  It  is  extremely  simple  to  answer  sphere-sphere  and  face-sphere  intersection 
queries.  Now,  the  content  of  each  cell  is  the  set  of  faces  intersecting  with  the  associated 
sphere  and  is  denoted  C(c).  We  color  a  leaf  black  or  white  depending  upon  whether  the 
sphere  is  totally  inside  or  outside  the  object.  We  color  it  gray  when  C(c)  is  nonempty.  As 
one  can  see,  using  the  tree  structure  we  may  place  the  elements  of  the  net  in  a  hierarchical 
organization  to  support  efficient  intersection  algorithms. 

We  now  come  to  the  method  of  constructing  the  tree.  For  convenience  let  us  call 
the  process  solidification.  Clearly  the  iterative  part  of  solidifeation  is  simple.  With 
proper  initialization,  we  simply  recursively  split  a  cell  into  eight  equal  parts  and  update 
the  appropriate  data  structures.  The  splitting  of  a  sphere  is  done  by  dividing  the  bounding 
cube  into  eight  equal  size  cubes  and  then  associate  the  dcscendcnt  cells  with  the  bounding 
spheres  of  these  smaller  cubes.  The  main  problem  is  the  termination  condition.  Intuitively, 
we  wish  to  split  the  cells  until  we  have  separated  the  face  elements  into  small  groups. 
However,  we  cannot  use  |C(c)|  directly  because  a  cell  can  intersect  with  the  same  face 
elements  no  matter  how  small  the  cell  size  become.  What  we  need  is  some  function  to 
measure  the  amount  of  faces  in  a  cell.  Using  this  function  we  can  split  each  cell  until  the 
amount  of  faces  it  contains  is  sufficiently  small.  On  the  other  hand,  we  do  not  wish  to  have 
each  face  contained  in  too  many  cells,  thereby  causing  both  Lime  .and  space  inefficiency. 
To  balance  the  trade-off  we  use  the  fraction  of  a  face  in  a  cell  as  the  amount  parameter  for 
that  particular  face  and  cell. 

To  solve  the  above  problem  we  construct  the  following  functions. 

v{c)  = 

f€C(c) 

v  (/»c)  =  Hri/rf)> 

6(d)  =  (  0  ir  d  - 

l  1  otherwise, 

r,  =  min{r/,rc,r/  +rc  -  |vc  -  v,|), 

where  rj  and  rc  are  the  associated  length  of  face  /  and  cell  c,  resp.  More  explicitly, 
rj  is  the  square  root  of  the  area  of  /,  while  r(.  is  the  radius  of  the  sphere.  vr  and  vj 
stand  for  the  centers  of  c  and  /,  resp.  6  is  a  threshold  function  with  threshold  level 
d.  Essentially,  fj  measures  fractional  face  content  of  /  in  c.  However,  measuring  the 

two-dimensional  intersection  area  between  /  and  c  is  not  too  simple.  Instead,  we  use  an 
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•  one-dimensional  analog  for  calculating  the  size  of  intersection.  Segments  of  length  ry  and 
rc  are  appropriately  placed  on  the  line  joining  vy  and  vc.  We  then  evaluate  the  length 
of  intersection  r,-.  Using  the  ratio  r,/ry  we  determine  if  /  is  contained  in  c.  Here  the 
parameter  d  comes  into  play.  A  value  of  1  / 2  is  probably  a  reasonable  value  for  d. 

The  intuitive  meaning  of  r\  should  now  be  clear.  Basically,  r\  measures  the  face  con¬ 
tainment  c  has.  c  is  said  to  contain  /  if  the  size  of  intersection  between  /  and  c  is  large 
enough  compared  to  the  size  of  /.  Now  the  termination  condition  for  solidification  can 
be  stated.  Each  leaf  cell  shall  have  its  r?  value  less  than  some  specified  cell  capacity  5. 
It  is  recommended  to  have  5  «  10.  Observe  that  as  long  as  S  is  positive,  termination  of 
solidification  is  guaranteed.  This  is  by  noting  the  property  that  rj(c)  \  0  as  rc  \  0. 

Algorithms: 

We  have  already  discussed  two  algorithms  in  constructing  the  primitives,  namely 
refinement  and  solidification.  To  perform  set  operation  on  two  objects,  we  need  a  net- 
joining  procedure  to  compute  a  sufficiently  tight  net  for  the  resulting  object.  Thus,  it  is 
necessary  to  compute  the  intersection  curves.  One  way  to  obtain  the  curves  is  to  find 
the  intersection  points  between  edges  of  one  net  and  faces  of  the  other.  For  convenience, 
we  shall  refer  to  these  points  as  knots.  The  knots  constitute  rope(s)  for  the  intersection 
curvcs(s).  The  resulting  net  with  the  deletion  of  appropriate  faces  and  introduction  of  new 
faces  and  sufficiently  tight  ropes  for  the  intersection  curves  is  the  desired  net  representation 
for  the  final  object. 

-  Finding  the  knots  requires  an  iterative  intersection  algorithm.  The  idea  of  our  al¬ 
gorithm  is  to  use  the  intersection  between  e  and  /  in  world  space  as  the  initial  point  p. 
Wc  continue  the  initialization  process  by  computing  q,.  .and  <fy  in  object  space  on  c  and  /, 
resp.,  using  a  linear  approximation.  The  linear  approximation  simply  uses  the  associated 
weights  p  has  on  the  vertices  of  e  and/or  /,  and  applies  them  in  the  corresponding  object 
space.  To  iterate,  wc  use  the  tangent  line  on  q,  and  tangent  plane  on  <fy  to  compute  the 
new  p  in  world  space.  Let  p,.  and  py  be  the  image  of  </,.  and  iff  under  M,  resp.  Wc  use  the 
difference  p  — pc  and  p  — py  to  perturb  the  object  coordinates  qc  and  <fy.  By  differentiating 
the  equation  i  =  M(u),  wc  obtain  the  linear  approximation 

A(li)  =  ^A(u')- 

Inverting  the  matrix  wc  then  express  A(u)  in  terms  of  A(z).  Using  the  perturbation  formula 
wc  compute  the  new  q,.  and  <//•  The  proper  termination  condition  for  the  iteration  is  simply 
that  distance  |pr  —  py|  be  less  than  some  user-specified  tolerance.  Occasionally,  however, 
the  iterated  qc  or  <fy  would  be  pushed  out  of  the  intcrv.il  specified  by  the  vertices  of  e  or 
/.  In  that  case,  appropriate  refinement  of  e  and  /  is  taken  before  the  iteration  halts. 

One  should  note  that  the  above  algorithm  would  work  only  if  the  edge  has  only 
one  varying  object  coordinate.  In  the  case  of  two  varying  coordinates,  the  edge  together 
with  its  edge  neighbor  form  an  intersection  curve.  Thus,  the  problem  of  three  primitives 
intersecting  together  is  at  hand.  A  modification  of  tiic  algorithm  is  required.  Instead  of 
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a  tangent  line  on  qe  as  above,  wc  use  two  tangent  planes  on  qe  and  its  neighboring  point. 
Thus,  p  is  now  the  intersection  between  three  planes  instead  of  between  a  line  and  a  plane. 

Finding  the  knots  can  now  be  done  easily  by  inquiring  possible  intersections  between 
gray  cells  of  the  two  objects.  Each  knot  splits  the  corresponding  edge  and  face.  The  original 
edge  splits  into  two  edges  with  one  visible  and  the  other  hidden ,  depending  upon  the  set 
operator  and  the  orientation  of  the  face.  (Note:  if  the  face  docs  not  have  an  inside-outside 
orientation,  then  the  two  edges  would  both  be  visible.)  After  the  splitting  process  is  done, 
the  parts  of  the  nets  that  are  hidden  may  be  removed  using  a  seed- fill  algorithm. 

Connecting  the  knots  to  form  ropes  for  the  intersection  curves  is  the  next  task  in 
the  net-joining  procedure.  This  can  be  done  by  using  the  neighborhood  information  of 
the  knots  as  stored  in  the  fedge  lists.  The  rest  of  the  procedure  is  simply  cleanup  work 
involving  further  refinement  of  the  ropes. 

Implementation:  The  algorithms  up  to  knot-finding  have  been  implemented  on  a  512K 
Macintosh.  The  rest  of  the  work  is  being  continued  on  the  SUN  workstation. 
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drawing  edge  name:  26 
showLine: 

from  -24.999994,  -43.301273,  40.000000 
to  50.000000,  0.000009,  40.000000 
drawing  edge  name:  9 
???  degenerate  edge  ??? 
drawing  edge  name:  28 
???  degenerate  edge  ??? 
drawing  edge  name:  30 
showLine: 

from  -24.999992,  43.301273,  40.000000 
to  -0.000000,  0.000000,  40.000000 
showPrimitive  done!!! 
pause  routine  :  enter  a  char  command: 


drawing  edge  name:  69 
showLine: 

from  -24.999994,  -43.301273,  40.000000 
to  0.000001,  -50.000000,  40.000000 
drawing  edge  name:  70 
showLine: 

from  0.00000|L  -50.000000,  40.000000 
to  24.9999913,  -43.301273,  40.000000 
drawing  edge  name:  68 
showLine: 

from  24.999996,  -43.301273,  -40.000000 
to  24.999996,  -43.301273,  40.000000 
showPrimitive  done!!! 
pause  routine  :  enter  a  char  command:! 
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APPENDIX  E 


by  David  M.  Chelberg 


Introduction 

This  appendix  describes  a  design  for  a  system  to  model  sensors  and  vision  algorithms 
and  describes  a  partial  implementation  of  the  system.  Given  sensor  and  algorithm  models 
and  mathematical  models  of  objects  we  want  to  recognise,  the  system  has  the  capability  to 
make  predictions  about  which  combinations  of  sensors  and  algorithms  will  be  most  likely  to 
meet  a  set  of  user- specified  constraints.  This  makes  it  possible  to  determine  appropriate 
sensor  and  algorithm  combinations  for  visual  tasks,  e.g.  to  locate  an  object  or  class  of 
objects. 


Background 

Current  computer  vision  systems  are  dependent  on  the  type  of  input  data.  Their 
dependence  on  a  particular  sensor  type  is  usually  embedded  implicitly  throughout  the 
system  where  it  is  difficult  to  eradicate.  The  same  is  true  for  vision  algorithms.  High  level 
systems  do  not  consider  how  data  was  acquired,  and  do  not  have  means  to  account  for 
systematic  and  random  errors  of  sensors  and  low-level  algorithms. 

Typically,  high  level  systems  cannot  make  accurate  use  of  data.  For  example,  the  point 
scattering  error  of  edge  elements  depends  on  contrast  [Binford  81].  Without  a  model  of  this 
dependence,  high  level  systems  must  assume  some  safe  worst  cast  which  is  likely  to  be  a 
factor  of  10  worse  than  necessary.  Where  there  are  multiple  parameters,  high  level  systems 
have  no  method  for  parameter  adjustment  which  leaves  them  with  non-optimal  settings. 
Even  though  the  data  from  sensors  and  low-level  algorithms  have  severe  faults,  high-level 
systems  could  perform  substantially  better  by  making  better  use  of  these  low-level  data. 

For  example,  in  [Brooks  81],  an  example  of  aircraft  recognition  was  given.  In  figure 
9.6,  a  view  of  a  terminal  at  San  Francisco  airport  with  6  aircraft,  the  limitations  of  the 
ribbon  finder  on  small  figures  are  apparent.  The  ribbon  finder  found  ribbons  suitable  to 
recognize  only  one  aircraft.  In  a  subsequent  experiment  I  carried  out  using  ribbons  fit  by 
hand  to  the  edges  from  the  Nevatia-Babu  edge  finder,  ACRONYM  found  all  6  aircraft.  It 
is  impossible  to  separate  out  the  powerful  human  perceptual  capabilities  in  this  simulation 
of  a  ribbon  finder,  but  prediction  of  the  performance  of  the  NevatiarBabu  ecje  finder  was 
crucial  in  this  intermediate  level  function. 

Another  problem  of  current  vision  systems  is  their  lack  of  ways  of  operating  u  multi¬ 
sensor  environments.  To  hadle  this  situation  adequately,  it  is  necessary  to  characterize  the 
nature  of  each  sensor,  including  the  type  of  information  each  sensor  provides  as  well  as 
how  the  sensor  obtained  the  information  [Henderson  84a,  84b].  The  type  of  information 
necessary  is  often  characterizable  as  a  vector  of  a  few  properties  of  the  sensor,  such  as  type 
of  output  (e.g.  gray  level  resolution,  spectrum),  what  it  measures  (range,  image  intensity), 
standard  deviation,  gain  and  bias,  repeatability,  dynamic  range,  optics,  and  the  image 
input  to  the  sensor.  Measures  of  digitization  and  sampling  are  included  because  we  are 


dealing  with  digital  data. 


Sensor  Modeling 

The  first  goal  of  this  system  is  to  model  various  sensors  and  algorithms  adequately.  To 
do  this,  a  framework  for  modeling  was  developed,  the  most  important  aspects  of  a  sensor 
are  what  it  senses  and  what  type  of  information  it  returns.  For  example,  a  camera  senses 
spatial  light  intensity  and  returns  a  set  or  field  of  vectors  giving  position  and  intensity 
information.  Thus  a  camera  transforms  its  input  data  -  the  light  incident  in  its  field  of 
view,  into  density  of  dye  components  at  a  point  on  the  film  plane.  Another  example  is  a 
laser  range  finder.  One  type  measures  the  phase  of  a  return  signal,  proportional  to  the 
distance  to  a  reflecting  surface  along  the  sensor  direction.  This  information  is  a  triple  of 
range  (modulo  wavelength)  and  two  angles  for  the  direction. 

A  uniform  method  of  modeling  sensors  and  algorithms  must  describe  the  transforma¬ 
tions  that  sensors  and  algorithms  perform.  We  achieve  this  by  thinking  of  both  algorithms 
and  sensors  as  functions  which  transform  their  inputs  to  produce  outputs. 

This  uniform  approach  models  composing  an  algorithm  with  a  sensor  as  a  composition 
of  their  functions.  Predictions  abot  the  performance  of  various  combinations  is  a  major 
reason  for  our  modeling  of  them,  since  this  will  allow  determining  the  best  selection  for  a 
vision  task. 

The  properties  of  sensor  and  algorithm  must  be  modeled  with  statistical  and  para¬ 
metric  models.  Models  must  interact  within  the  overall  system  and  relate  to  other  models. 
The  faithfulness  of  models  to  the  real  world  is  one  criterion  for  choice  of  model;  the  sim¬ 
plicity  of  the  model  for  symbolic  prediction  is  another.  The  design  philosophy  thus  far  has 
been  to  begin  with  simple  models  but  to  design  the  system  to  allow  more  complex  models 
as  necessary.  The  framework  encompasses  these  models  naturally.  It  is  intended  that  the 
system  choose  model  complexity  to  fit  the  requirements  of  the  system  measurement. 


Prediction  System 

The  prediction  system  is  intended  to  produce  grey  scale  imagery,  color  imagery,  depth 
maps,  edge  maps,  and  other  outputs.  Outputs  can  be  produced  from  the  polyhedral 
approximations  to  generalized  cylinders,  or  symbolic  descriptions  of  various  output  types 
may  be  generated  for  classes  of  generalized  cylinders.  For  example,  for  cylinders,  the 
system  would  predict  step  edge  intensity  profiles  for  the  ends  of  the  cylinder,  and  curved 
edge  intensity  profiles  for  the  limbs  (apparent  edges). 

The  prediction  system  will  have  to  determine  the  performance  of  sensors  and  algo¬ 
rithms  given  their  models,  task  models,  and  object  models.  This  system  will  be  complex. 
The  current  design  calls  for  implementation  of  this  system  as  a  search  over  the  graph 
of  sensor  and  algorithm  combinations,  supplemented  by  a  suite  of  functions  which  can 
determine  input/output  characteristics  of  a  sensor  or  algorithm  from  the  model  of  the 
sensor. 

A  difficult  part  of  this  may  be  making  the  models  of  algorithms.  The  behavior  of 


algorithms  is  not  modeled  in  most  publications.  I  currently  plan  to  start  with  a  few 
algorithms  that  have  been  developed  at  Stanford  since  I  have  access  to  people  who  know 
the  behavior  of  the  algorithms. 


Implementation  of  the  Sensor  Modeling  System 

The  current  implementation  is  in  Frans  Lisp  with  a  record  package  to  define  structured 
data  representations.  A  sensor  or  algorithm  is  defined  as  an  object  with  the  following  slots: 
a  unique  name;  a  set  of  input  types  -  which  can  be  the  real  world  for  sensors;  a  description 
of  the  output;  a  set  of  properties  of  the  sensor,  such  as  resolution,  sensitivity,  etc. 

Using  this  framework,  a  program  can  form  a  graph  with  all  possible  combinations  of 
sensors  and  algorithms.  The  graph  can  be  partitioned  on  the  basis  of  final  output  types. 
It  is  not  necessary  or  likely  to  build  this  entire  graph.  Parts  of  it  may  be  generated  in 
response  to  different  request  of  the  system  and  then  stored  for  later  use.  It  is  useful  to 
think  of  prediction  as  being  a  search  of  a  portion  of  the  graph,  using  constraints  to  guide 
the  search. 


Object  Modeling 

The  current  system  relies  on  the  ACRONYM  modeling  system.  This  system  uses 
generalized  cylinder  primitives  with  restrictions  to  implement  object  classes.  An  interface 
to  this  system  to  allow  generation  of  polyhedral  approximations  to  generalized  cylinders 
was  written.  Extensions  were  made  to  the  modeling  system  to  allow  specification  of  surface 
properties  of  objects,  such  as  color  and  specular  and  diffuse  ?????  The  prediction  part  of 
the  system  has  yet  to  be  implemented,  components  of  reflectivity. 
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Abstract 

The  purpose  of  this  work  is  to  provide  the  elements  of  a  symbolic  graphics  system: 
modeling  language,  geometric  models  and  splines  plus  algorithms  to  represent  the  visible 
and  hidden  surfaces.  It  extends  previous  work  on  a  display  program. 


Introduction 

The  input  to  the  graphics  system  consists  of  of  combinations  of  generalized  cylinders 
defined  using  a  modeling  language.  A  new  formulation  for  a  wide  class  of  cylinders  is  used, 
based  upon  curves  defined  by  splines.  The  spline  method  which  is  not  yet  completely 
derived,  takes  point,  tangent  and  curvature  boundary  conditions  and  interpolates  with 
continuous  tangent  and  curvature. 

The  output  consists  of  a  description  of  the  model  surfaces  and  a  description  of  the 
image.  It  divides  the  model  surfaces  into  their  forward  facing,  back  facing  and  occluded 
regions  which  are  paired  with  the  areas  of  image  on  which  they  project. 

Many  of  the  intervening  algorithms  such  as  limb  following,  special  cases,  and  formulae 
for  derivatives  of  surface  normals  are  simplified  and  formalized  from  the  previous  display 
program. 

The  remaining  sections  of  the  report  are: 

1.  Class  of  generalized  cylinders 

2.  Modeling  language 

3.  Classification  of  limb  points 

4.  Spline  method 

5.  Extensions  to  Graphics 

6.  References 


1.  The  Class  of  Generalized  Cylinders 


1.  Class  of  generalized  cylinders 

1.1  Overview 

1.2  Examples 

1.3  Spline  with  frames 

1.4  Loops  and  singular  points 

1.5  Evaluation,  compliling,  and  discontinuities 


1.1  Overview 

(See  [l]  and  [2]).  Members  of  the  class  of  generalized  cylinders  are  defined  by  three 
successive  sweeps:  from  point  to  curve  to  ribbon  to  generalized  cylinder.  The  terms  used 
here  are  that  a  “cross-section”  is  swept  along  a  “spine”  curve  to  form  a  “section”.  The 
cross-section  can  be  a  point,  curve  or  area  and  the  section  is  a  curve,  ribbon,  or  generalized 
cylinder  respectively.  (Section  n)  is  the  class  of  an  object  formed  by  n  sweeps.  At  the  lowest 
level  of  the  modeling  system  the  curves  are  generated  by  splines. 

The  bottom  and  top  cross-sections  are  positioned  relative  to  each  other  by  placing 
the  lower  end  of  the  spine  at  an  attachment  point  on  the  bottom  cross-section  and  then 
placing  the  top  cross-section  on  the  upper  end  of  the  spine. 

The  top  cross-section  is  a  deformation  of  the  bottom  one.  Intermediate  cross-sections 
are  produced  by  partially  deforming  the  bottom  cross-section. 

The  spine  is  a  moving  frame,  whose  axes  at  a  point  orient  the  cross-section.  For 
example  to  twist  a  cross-section,  the  axes  of  the  moving  frame  rotate  about  the  spine 
tangent.  Having  a  frame  at  every  point  allows  the  special  cases  of  translation  and  rotation 
to  be  treated  uniformly:  For  translation,  the  frames  are  parallel  and  the  cross-section  is 
not  deformed  as  it  is  swept:  There  is  no  need  to  have  an  attachment  point  between  the 
spine  and  cross-section,  because  all  attachments  produce  the  same  figure.  Rotation  about 
a  point  occurs  when  all  the  points  of  the  spine  are  coincident. 

The  sweeping  rule  is  defined  completely  by  the  spine,  deformation  and  attachment 
point;  these  elements  are  independent  of  each  other  and  of  the  cross-section,  so  that  com¬ 
ponents  from  different  GCs  can  be  recombined. 

The  deformation  ihethod  follows  after  some  examples  defining  a  cuboid  and  a  right 
circular  cone. 


1.2  Examples 


A  cuboid  with  sides  11, 12,  13: 

((Class  GC)  (Name  cuboid) 

(Variables  (11)  (12)  (13)) 

(Spine  (straight  (length  (13)) 

(direction  zhat))) 

(Cross-area  rectangle) 

) 

((Class  ribbon)  (Name  rectangle) 

(Variables  (11)  (12)) 

(Spine  (straight  (length  (12))  (direction  yhat))) 

(Cross-curve  (straight  (length  (11))  (direction  xhat))) 

) 

The  top  and  bottom  cross-sections  are  equal,  and  no  attachment  point  is  needed  to  connect 
the  spine  and  cross-section  because  it  is  a  translation. 


•  I 


A  generic  cone: 

((Class  GC)  (Name  cone) 

(Variables  (radius)  (height)) 

(Spine  (straight  (length  (height))  (direction  zhat))) 

(Cross-area 

!  (Bottom  (circle-area  (center  origin)  (radius))) 

(Top  (Deform  bottom  (shrink-to-point  center)))) 

(Attach  (frame  center  unit-axes)) 

) 

Here  the  bottom  cross-section  is  a  circle  area,  the  top  cross-section  is  the  singular  center 
point,  while  intermediate  cross-sections  shrink  the  circle  radius  linearly  down  to  zero. 
((Class  ribbon)  (Name  circle-area) 

(Variables  (radius)  (center)) 

|  (Spine  (center)) 

(Cross-area 

i  (Bottom  (circle  (radius)  (center))) 

(Top  (Deform  bottom  (shrink-to-point  (center))))) 

(Attach  (frame  (center)  unit-axes)) 

I  A  particular  cone: 

((Class  cone)  (Name  conel) 

(Radius  1.0  (unit  inch)) 

(Height  5.0  (unit  inch)) 

) 

A  cuboid  with  the  cross-curve  of  its  rectangular  cross-section  warped  into  a  circular  arc  of 
I  angle  two  theta: 

!  ((Class  GC)  (Variables  (theta)  (11)  (12)  (13)) 

(Deform  (ref  (cuboid  cross-curve)) 

(Deform  (ref  (top  tangent)) 

(Rotate  (angle  (theta))  (axis  zhat))) 

(Deform  (ref  (bottom  tangent)) 

(Rotate  (angle  (minus  (theta)))  (axis  zhat)))) 

!  ) 

i 
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1.3  Splines  with  Frames 

A  moving  coordinate-frame  along  the  spine  determines  the  orientations  of  cross-sections. 

Given  a  directed  curve  in  the  xy  plane,  natural  axes  can  be  assigned  uniquely  by 
rotating  the  xyz  unit  frame  about  the  z  axis  to  align  the  x  axis  with  the  curve  tangent. 
The  axes  can  be  reoriented  by  twisting  around  the  tangent  direction;  in  general  there  are 
axes  boundary  conditions  in  the  form  of  orientation,  instantaneous  axis  of  rotation  and 
rate  of  rotation.  ^ 

In  addition  a  curve  with  axes  along  its  length  can  be  deformed  by  changing  the 
position,  tangent  and  curvature  boundary  conditions.  Two  things  can  happen  to  the  axes. 
They  can  either  be  kept  at  constant  absolute  orientation  or  they  can  be  rotated  so  that 
their  orientation  relative  to  the  natural  frame  is  kept  constant.  Corresponding  points  on 
the  original  and  deformed  curves  have  the  same  ratio  of  arc  length  to  total  curve  length. 
For  example  a  helix  formed  by  a  straight  spine  with  twist: 

((Class  GC)  (name  helix) 

(Variables  (height)  (pitch)  (big-radius)  (small-radius)) 

(Spine  (Deform  (straight  (direction  zhat) 

(length  (height)) 

(axes  unit-axes)) 

(Deform  (top  axes) 

(Rotate  (axis  zhat) 

(Angle  (*  (pitch)  (height))))))) 

(Cross-section  (circle-area  (radius  (small-radius)) 

(center  (big-radius)  0.0))) 

(Attach  (frame  unit-frame))) 

1.4  Loops  and  Singular  Points 

It  is  important  to  have  topological  features  repesented  by  the  model;  eg.  curves  which 
form  loops  or  singular  points  instead  of  a  closed  interval.  This  allows  things  like  the  hole 
in  the  torus  and  the  point  on  top  of  a  cone  to  be  deduced.  The  axes  along  a  looped  spline 
must  rotate  an  integer  number  of  times.  There  are  two  ways  to  form  a  volume  or  ribbon 
with  a  hole;  one  is: 

(Spline  loop  (boundary-conditions)), 

the  other  is  when  the  two  spine  sweeping  method  has  the  bottom  end  of  one  spine  positioned 
at  the  top  of  the  other. 

The  only  way  that  points  and  lines  can  be  singular  i.e.,  have  a  dimension  smaller 
than  expected,  is  when  the  deformation  shrinks  to  zero,  or  in  the  two  spine  case,  when  the 
spines  cross  each  other,  eg.  in  the  dumb-bell  definition  above. 


1.5  Evaluation,  Compiling  and  Discontinuities 
Evaluation: 

(Section  n)  is  generated  by  up  to  four  sweeps  with  parameters  named  tl,  t2,  t3  and  t 
for  sweeping  through  time.  By  setting  values  to  a  subset  of  these  parameters,  (Section  n)  is 
evaluated  to  yield  an  object  of  class  (Section  m)  formed  by  the  sweeps  of  the  remaining 
unset  parameters.  For  instance, 

(Section  3)(tl  t2  t3)  =  point  on  generalized  cylinder, 

(Section  3)(t3)  =  a  ribbon, 

(Section  3)(tl)  =  a  ribbon:  t2  spine  swept  along  the  t3  spine. 

The  formulae  for  the  first  and  second  derivatives  are  computed  automatically.  Eg.  and 

dip  . 
dtldtZ' 

(Derivel  (parameter  tl)  (Section  3)  (tl  t2  t3)) 

(Derive2  (parameters  t2  t3)  (Section  3)  (tl  t2  t3)) 

The  bounds  on  the  parameters  form  a  cuboid  of  parameter  space.  If  (tl  t2  t3)  lies  on  the 
surface,  then  the  surface  normal,  given  by  (Normal  (Section  3)  (tl  t2  t3))  equals  the  dot 
product  of  the  parameter  space  surface  normal  with, 


where  X  means  cross  product  and  p  is  the  position  on  the  GC  surface. 

Discontinuities: 

When  the  parameters  lie  on  a  corner  or  edge  of  the  parameter  cube,  or  when  some  of 
the  defining  splines  have  a  tangent  discontinuity  at  that  parameter  point,  then  the  cylinder 
has  a  surface  tangent  discontinuity.  Then  the  formula  above  gives  a  list  of  normals  from 
which  any  sum  of  positive  multiples  is  perpendicular  to  the  surface. 

Compiling: 

The  three  main  parts  to  compiling  a  generalized  cylinder  definition  are:  calculating 
the  spline  parameters;  forming  lisp  functions  for  position  and  its  derivatives;  and  building 
a  data  structure  to  keep  track  of  where  the  present  parameter  point  is  located  compared 
to  the  discontinuities. 

2.  Modeling  Language 

Examples  of  the  modeling  language  were  used  to  describe  the  class  of  generalized  cylinders, 
so  this  section  is  brief. 

2.1  Top  Level 

2.2  External  input  format:  Names,  definitions,  references 

2.3  Incomplete  definitions  and  quoting 

2.4  Name  environment 
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2.1  Top  Level 

At  the  highest  level  the  modeling  system  is  a  network  of  nodes,  each  of  which  has  a  class 
rule  and  a  value  rule  associated  with  it,  which  must  be  known  beforehand  to  access  the 
node.  Different  kinds  of  nodes  have  different  rules. 

Class-rule:  Node  •— ►  Class 
Value-rule:  Node  •— ►  Value 

The  nodes  and  rules  of  immediate  interest  are  those  of  the  external  input  format  of  the 
modeling  system.  The  input  function  takes  a  list  of  definitions,  which  it  first  stores  exactly 
as  is.  Then  it  goes  through  and  expands  the  definitions. 

2.2  External  Format:  Names,  Definitions,  References 

There  are  three  basic  formats  for  an  input  node,  examples  of  which  are: 

((Class  C)  (Value  V)),  and 
((Value  V)  (Class  C)),  and 
(C  V) 

where  C  and  V  are  names  of  other  nodes.  To  give  the  node  (C  V)  the  name  “N”,  insert 
“(Name  N)”  to  the  list,  or  alternatively  put  (C  V)  into  the  value  position  and  (Name  N) 
in  the  class  position: 

(C  (Name  N)  V),  or 
((Name  N)  (C  V)) 

If  also  the  node 

((Name  C)  (Class  D)  (Value  W)) 
is  input,  then  the  system  links  to  form  the  internal  equivalent  of: 

((Name  N)  (  ((Name  C)  (Class  D)  (Value  W))  V)). 

Apart  from  a  name,  two  other  kinds  of  reference  are  possible.  The  most  common  one  is  a 
nested  definition,  which  takes  the  form  of  a  list  of  nodes;  for  example  the  two  equivalent 
forms  below.  The  field  classes  A  and  B  can  be  omitted  when  their  values  appear  in  the 
same  order  as  they  were  given  in  the  definition  of  C. 

('Hass  C)  (A  (X  Y))  (B  Z)). 

(C  (X  Y)  Z) 

((Class  record)  (name  C)  (Helds  (A)  (B))) 

The  final  kind  of  reference  is  a  path  to  a  previously  defined  node  eg: 

((Class  O)  (reference  (N  (A  X)))),  or 
((Class  O)  (reference  (C  (A  X)))) 
which  are  both  converted  internally  to, 

((Class  O)  (X  Y)). 

An  alternative  form  is  to  reverse  the  reference  path,  as  in 
((Class  O)  (reference-of  (X  (A  N)))). 

Also  the  forms, 

(Value-of  N)  and 
(Class-of  N) 

yield  V  and  C  respectively. 


2.3  Incomplete  Definitions,  and  Quoting 

A  definition  is  incomplete  when  a  node  has  a  class  but  no  value;  for  example  a  variable 
in  a  function  definition,  or  a  field  in  a  record  definition;  see  the  definition  of  a  generic  cuboid 
in  section  1.2.  It  is  indicated  by  brackets  around  the  class  eg. 

(C)  instead  of  (C  V).  Sometimes  parts  of  a  definition  are  quoted  to  prevent  them  from 
being  expanded  upon  input,  for  example  when  a  value  does  not  have  the  input  format. 
The  class  will  contain  instructions  on  how  to  interpret  the  value  but  the  input  method 
does  not  know  that.  (If  the  class  is  missing  from  the  modeling  system  then  the  class  is  the 
programmer  himself,  who  had  better  know  how  to  interpret  the  value  structure.  For  want 
of  a  better  name  this  class  is  called  God.)  The  other  main  use  of  quoting  is  in  “(Name 
N)”  which  quotes  “N”  automatically.  If  this  were  not  so  the  name  would  be  recursively 
expanded  for  ever. 

3.  Classification  of  Limb  Points 

A  classification  of  seven  types  of  limb  point,  their  properties  and  their  possible  orders  is 
part  of  a  robust  limb  following  algorithm  [10]  and  also  of  theoretical  interest.  It  is  derived 
by  considering  five  kinds  of  surface  patch  and  the  ways  that  limbs  can  cross  them. 

The  surface  patches  are: 

A  smooth, 

B  crossed  by  an  edge, 

C  with  a  junction  point  of  three  or  more  edges, 

D  with  a  singular  point  like  the  top  of  a  cone,  and 
E  with  the  end  point  of  a  crease. 

A  must  have  a  smooth  limb  crossing  it,  (1). 

B  has  three  types  of  limbs:  Straight  along  the  edge  (2),  crossing  over  the  edge  (3),  and 
half  off  the  edge  and  half  on  it  (4).  Types  (1)  and  (2)  have  no  tangent  discontinuities  on 
the  surface,  in  the  image  or  in  their  parameter  values.  Type  (3)  has  surface,  image  and 
parameter  tangent  discontinuities.  Type  (4)  differs  from  (3)  by  being  continuous  in  the 
image. 

C  has  three  types  of  limb:  (3),  (4)  and  one  which  switches  edges  (5),  having  surface,  image 
and  parameter  discontinuities. 

D  has  one  limb  type  (6),  with  surface,  image  and  parameter  discontinuities. 

E  has  two  types,  (6),  and  (7)  which  falls  off  the  end  of  the  crease,  giving  surface,  image 
and  parameter  discontinuities. 

The  ordering  constraints  are  obvious,  eg.  (1)  must  be  linked  to  (2)  via  (4)  or  (7).etc. 
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ABSTRACT 

■  Minimum  time  paths  for  a  two-link  robot  arm  are  determined  so 
that  the  tip  moves  a  specified  distance,  starting  from  rest  and 
ending  at  rest.  Two  torquers  are  used,  one  at  the  shoulder  and 
one  at  the  elbow,  each  having  bounded  torque.  The  optimal 
locations  of  the  two  end  points  in  the  robot  coordinate  system 
are  determined  as  part  of  the  solution.  The  paths  are  found  to 
be  "bang-bang"  in  both  controls.  For  distances  that  are  small 
compared  to  the  reach  of  the  arm,  the  minimum  time  paths  are 
asymmetric,  changing  to  symmetric  paths  when  the  distance  is  just 
slightly  less  than  the  maximum  reach  of  the  arm. 

■  A  new  gradient  algorithm  for  systems  with  multiple  bounded 
controls  was  developed  to  solve  the  problem  (cf.  Ref.  1). 

INTRODUCTION 

■  Robot  arms  are  now  used  in  many  industries.  As  of  now,  they 
are  massive  and  move  relatively  slowly.  To  move  the  tip  along  a 
prescribed  path,  appropriate  joint  angle  histories  are  determined 
and  servo-actuators  at  each  joint  cause  these  histories  to  be 
followed  as  closely  as  possible.  The  limits  on  speed  are  (1)  the 
maximum  available  torques  at  the  joints,  and  (2)  vibrations  of 
the  links.  The  faster  the  arm  moves,  the  more  work  it  can  do,  so 
minimum-time  paths  are  of  considerable  interest. 


■  Me  consider  here  minimum-time  paths  to  move  the  tip  of  a  rigid 
two-link  robot  arm  with  a  tip  mass  (the  "payload")  through  a 
specified  distance,  starting  and  ending  with  zero  velocity  <a 
"pick-and-place"  movement),  assuming  actuators  with  bounded 
torque  at  the  “shoulder"  and  the  "elbow"  (see  Figure  1).  A  unique 
feature  of  our  formulation  of  the  problem  is  that  the  optimum 
orientation  of  the  arm  with  respect  to  the  line  connecting  the 
two  end  points  is  determined.  Previous  work  on  this  type  of 
problem  is  contained  in  Refs.  3  through  3. 


|  £  EQUATIONS  OF  MOTION 
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■  The  equations  of  motion  are 
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C&)|  »^2  ^  *  angular  velocity  of  link  Ci,  23, 
a  ■  elbow  angle, 

e  *  angle  of  link  1  relative  to  its  initial  orientation, 
CQi,  Qa3  -  actuator  torques  at  Cshoulder,  elbow], 

and 

Cm,,  mal  =  masses  of  Clink  1,  link  2  +  tip  mass3. 


Clif  lal  -  length  o-f  link  Cl,  23, 


a  *  distance  from  elbow  to  center -o-f  -mass  of  (link  2  + 
the  tip  mass). 

Jit  ■  J»  +  i*a(l»)*, 

J*  »  moment-of-inertia  o-f  link  1  about  the  shoulder, 

J  ta  *  mal  li, 

Jaa  *  moment-of-inertia  of  (link  2  +  tip  mass),  about 
the  elbow. 

■  It  is  convenient,  for  numerical  integration,  to  put  Eqns.  (1) 
and  (2)  into  the  forms 
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THE  MINIMUM— TIME.  PROBLEH 


osa 

J aa,  —Jaa  —  JiaCosa 
-Jtacosa,  Jit  +  Jtacosa 
-  (Jia)*cas*a. 


■  We  wish  to  find  the  initial  elbow  angle  a(0),  and  the  control 
torques  Qt (t)  and  Qa(t)  to  move  the  tip  through  a  specified 
distance  L  in  minimum  time,  starting  and  ending  with  zero  tip 
velocity  with  the  control  torques  bounded,  i.e. 


|Qi(t) I  <  Qtn, 

I Qa ( t ) I  <  Qaw, 

■  The  distance  traveled  by  the  tip  may  be  expressed  as 
D(t)  -  C(x(t)  -  x (0) ) *  ♦  (y (t)  -  y(0))»3*'*, 
x  (t)  »  licos6(t)  laCOsCd(t)  +  a(t)l  , 
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y <t>  »  lisind(t)  +  lasinC6 (t)  «(t)3  .  (11) 

■  The  initial  conditions  are 

U),<0)  ■  0,  u)a<0)  ■  0  ,  6(0)  »  0  ,  (12) 

with  <x (0)  to  bs  determined. 

■  Ths  -final  conditions  are 

0(t«)  S  L,  0),  <t«)  ■  0,  U)j(t#)  a  0.  (13) 

■  An  intsoral  o-f  ths  moti on  is  obtained  by  observing  that  ths 
total  angular  momentum  o-f  ths  arm  is  squal  to  ths  angular  impulss 
impartsd  by  ths  shouldsr  torqusr,  i.s.  ^ 

(Jx*  -♦•  Jiacosa)  0J,  +  (JM  JtaCOsa)faJl  ■  |Q»dt,  (14) 

Sines  ths  -final  angular  moasntum  is  also  zero*  it  -follows  that 
ths  tims  intsgral  of  Qx (t)  ovsr  ths  whols  path  must  bs  zsro. 

THE  ACW  6RAD1ENT  ALGORITHM 

■  It  is  di-f-ficult  to  uss  ths  standard  -forms  of  ths  gradisnt 
algorithm  with  a  problem  having  bounded  controls.  A  new  gradient 
algorithm  was  developed  hers  to  solve  such  problems*  which  we 

call  ths  Adjustable  Control -Variation  ^aight  (ACW)  algorithm.  We 

describe  it  briefly  here  for  the  case  of  a  single  control  u(t) 
and  a  fixed  final  time  t*j  the  more  general  case  is  described  in 
Refs.  1  and  2. 


«  Consider  the  probli 

where  vector  x(t)  is 

with 

and 


>m  of  finding  a  scalar  u(t) 
J  -  0Cx(t«),t#3, 
determined  by 


x  ■  f (x,u), 
x (to)  specified* 


subject  to 


<p.Cx(t*>  ,t*3  -  0,  i  »  1, - ,p, 

lu(t) I  <  1. 


to  minimize 


(13) 

(16) 

(17) 

(18) 
(19) 


■  We  guess  a  nominal  u(t)  that  satisfies  the  constraints  (19). 
Then  variations  in  J  and  are  given  by 

W(t)tfu(t)dt,  (20) 


6  J 


H* 

4 

«  O 


U) 

;  -  V 

I  o 


(t)£u(t)dt*  i  ■  1, - ,p, 


(21) 


(S  fi) 

lere  CH a  <t ) ,  Hu  (t)3  are  the  impulse  response  functions  for 
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C<JJ,  S  <f/;  3,  determined  by  integrating  the  adjoint  equations 
backMard  over  the  nominal  path  (cf.  Ref.  2,  Section  7.4).  We 
choose  £u(t)  to  be  proporti.onal  to  H*<t)  plus  a  linear 
combination  o-f  the  other  H^tt)  -for  the  terminal  constraints! 


*u(t)  -  -kCH1*' (t)  +  v;  HlJ)(t)3,rt 


(22) 


where  k  is  positive  and  the  1 ’ s  will  be  determined  to  improve 
satisfaction  o-f  the  terminal  constraints  on  the  next  iteration. 


■  Substituting  (22)  into  (21)  gives 

where 


~p*  j  V4  -  g*, 
±f 


P*. 


<k*HtJ[>(t)*CHl<i>(t)  3T3dt, 

«  O 


9t 
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tkttf*'  (t)  tCH1!?  (t)  3T>dt. 


(23) 


(24) 


(23) 


The  linear  equations  (23)  are  solved  -for  the  if l  ’ s,  which  are  then 
used  in  (22)  to  form  the  constrained  impulse  response  -function 


H«(t) 


l«) 


U> 


K*<t)  +  y*  K*(t). 


(26) 


■  The  new  feature  is  that  we  use  k  -  k(u),  where  u  is  the  nominal 
u(t),  in  order  to  limit  ffu(t)  m  41  tB-gfy  llllld*.  thl  ..CPnitr  11  At 
boundary  and  never  quite  reach  it.  The  k(u)  that  we  use  in  (24) 
and  (23)  is* 


k (u)  *  cCl  -  lu(t) 13, 

where  c  is  a  positive  constant  (see  Fig.  2). 


(27) 


A  slight  change  in  k (u)  is  used  in  the  forward  integration  to 
avoid  "trapping"  the  control  near  a  boundary.  If  !u(t) !  >  1  -  ff 
and  u(t)tHu(t)  >  0,  then  use 


k  (u) 


c*  6 


(28) 


where  6  <<  1  (see  Fig.  2).  Note  (28)  is  used  only  when  u(t)  is 
far  from  the  optimal  u(t). 

■  The  choice  of  the  proportionality  constant  c  has  the  same 
difficulty  as  it  does  in  the  conventional  gradient  procedure. 

If  it  is  chosen  too  large  the  algorithm  becomes  unstable;  if  it 
is  chosen  too  small,  the  convergence  is  very  slow. 

MINIMUM-TIME  PATHS  FOR  A  TYPICAL  ARM/PAYLOAD  COMBINATION 

■  We  shall  consider  the  case  where 

m  *  iHt  *  fihi  *  np| 

i  -  i»  -  u. 
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where 


Qm  *  Qih  *  QaH| 

mass  of  payload  (the  "tip  mass"). 


Ws  shall  measure  ths  quantities  Jll€  in  units  o-f  ml*,  ths  time  in 
units  of  ths  characteristic  time  r  ■  Cml*/Q„3*'»,  the  angular 
velocities  in  units  of  1/f  ,  the  torques  in  units  o-f  GU,  and  the 
distances  (D,L)  in  units  o-f  1.  Using  these  units  for  the  case 
considered  we  have 


Jii  -  7/3,  Jia  ■  3/2,  Jsa  -  4/3,  (29) 

and 

!Q*(t){  £  1,  !Qa(t)S  £  1.  (30) 

■  Fig.  3  shows  the  minimum-time  path  for  L/l  »  0.4.  The  path  of 
the  tip  is  almost  a  straight  line)  there  is  only  one  switch  in 
the  shoulder  torquer  and  one  switch  in  the  elbow  torquer.  From 
the  integral  (14),  the  shoulder  switch  must  occur  at  t  *  t#/2. 

■  Fig.  4  shows  the  path  for  L/l  *  2.3.  The  shoulder  torquer 
switches  three  times  while  the  elbow  torquer  still  switches  only 
once. 


■  Fig.  5  shows  the  path  for  L/l  »  3.7.  The  tip  path  is  now 
svmmetr i c  with  respect  to  the  half-way  point.  The  shoulder 
torquer  still  switches  three  times  and  the  elbow  torquer  still 
switches  only  once.  Surprisingly,  the  time  required  is  less 
than  for  L/l  3  2.3,  where  the  path  is  not  symmetric. 

■  Fig  6  shows  the  path  for  L/l  ■»  4. 0  which  is  the  maximum  "reach" 
of  the  robot  arm.  The  tip  path  is  still  symmetric  but, 
surprisingly,  there  are  now  three  el bow-tor quer  switches  and  only 
one  shoulde? — torquer  switch.  The  angular  velocity  of  the  lower 
arm  (link  2)  is  very  low  as  the  tip  passes  through  the 
shoulder,  whereas  it  was  very  high  for  L/l  *  3.7. 

■  Fig.  7  shows  the  minimum  time  and  the  switching  times  vs. 
distance  traveled  by  the  tip.  The  character  of  the  paths  changes 
from  asymmetric  to  symmetric  for  L/l  >  2.6.  The  symmetric  paths 
change  from  "elbow  snaps"  to  "shoulder  snaps”  for  L/l  >3.7,  i.e. 
the  maximum  angular  velocity  occurs  for  the  upper  arm  (link  1) 
rather  than  for  the  lower  arm  (link  2). 

«  Fig.  8  shows  the  optimum  initial  elbow  angle  vs.  distance 
traveled  by  the  tip. 

15_THE_ SOLUTION  ALWAYS  BANG-BANS? 

■  Host  of  the  numerical  solutions  converged  to  paths  that  looked 
nearly  bang-bang.  However,  there  were  two  paths  (for  L/l  »  2.5 
and  3.3)  where  the  constrained  impulse  response  function  Hu*  (cf. 
Eqn.  (26))  for  the  shoulder  torque  was  very  close  to  zero  for  a 
finite  length  of  time,  indicating  the  possibility  of  a  singular 
arc  or  non-uniqueness.  These  are  shown  in  Fig.  9  along  with  the 
shoulder  torque  determined  by  the  ACW  gradient  algorithm. 


*  Hui  close  to  zero  indicates  that  the  final  time  is  indifferent 
to  changes  in  the  value  of  the  shoulder  torque.  In  other  words. 
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the  shoulder  torque  could  be  reduced  during  this  period  while  the 
elbow  torque  is  still  maximum.  Whether  the  shoulder  torque  should  b 
interior  to  the  constraints  (a  singular  arc),  or  whether  it  has 
some  extra  bangs  that  reduce  the  average  torque,  was  unclear  -from 
our  numerical  results}  obviously,  the  -final  time  will  not  be 
a-f-fected  significantly  one  way  or  the  other. 

■  Also,  the  periods  where  Hui  is  close  to  zero  correspond  to 
periods  where  the  arm  is  folded  (a  ~  180  deg),  which  causes 
Eqns.  (S)  and  (6)  to  be  one-wav  coupled  since  F(a)  ®  0  and  (Jaa 
♦  Jiacosa)  ~  0.  In  Ref.  1  it  is  shown  that  this  leads  to  non¬ 
uniqueness  of  one  of  the  controls,  which  seems  to  be  what  is 
happening  here. 

■  Physically,  the  extra  switches  (or  the  singular  arc  with 
intermediate  torque)  appear  to  be  an  attempt  to  keep  the  arm 
close  to  its  folded  position,  which  keeps  the  moment  of  inertia 
near  its  minimum  value. 


CHECKINS  THE  SOLUTIONS 

■  As  demonstrated  in  Fig.  9,  the  ACW  gradient  algorithm  did  not 
give  the  bang-bang  control  histories  shown  in  Figures  3  through 
6.  These  were  inferred  from  the  steep  (but  not  abrupt)  changes 
produced  after  many  iterations  of  the  ACW  gradient  algorithm. 

They  were  then  checked  and  "fine— tuned"  as  described  below. 

■  For  the  symmetric  paths,  only  the  first  half  of  the  path  has  to 
be  calculated.  However  this  means  taking  0(0)  not  equal  to  zero) 
0(0)  is  computed  from  the  expression  for  the  distance  traveled  for 
a  symmetric  path. 


L  *  2cos0(O)  +2cosC0 (0)  +  «(0)1,  (31) 

using  the  a(0)  determined  by  the  ACW  algorithm  (for  the  first 
try).  For  the  paths  with  one  elbow  and  three  shoulder  switches 
(L/l  »  3.3  and  3.7),  the  elbow  switch  and  one  of  the  shoulder 
switches  must  occur  at  t  *  t#/2.  The  other  two  shoulder  switches 
must  occur  symmetrically  about  t  *  t«/2.  Thus  the  first  shoulder 
switch  was  found  by  linear  interpolation  so  that  0  «  -  ir/2  when  a 
reached  i»}  the  time  at  which  this  occurs  is  t#/2.  The  whole 
procedure  is  then  repeated  with  slightly  different  values  of  a(0) 
to  determine  the  a(0)  that  minimizes  t«.  For  the  path  at  L/l  * 
4.0,  the  first  elbow  switch  was  found  in  the  same  manner. 

■  For  the  asymmetric  paths  with  one  elbow  and  one  shoulder 
switch,  (L/l  *  .4  and  1.0),  the  shoulder  switch  must  be  at  t  » 
t#/2  because  of  the  integral  (14).  Thus  we  pick  a  t«  and  find 
the  elbow  switch  time  by  linear  interpolation  to  cause  a)z(t«)  * 
0.  The  corresponding  value  of  D  is  then  calculated.  The  whole 
procedure  is  then  repeated  with  slightly  different  values  of  a(0) 
to  determine  the  a(0)  that  maximizes  0  for  the  chosen  t«. 

■  No  simple  procedure  was  found  to  check  the  asymmetric  path  for 
L/l  >2.3  with  one  elbow  switch  and  three  shoulder  switches.  It 
is  a  four  parameter  optimization  problem  for  a  given  t#,  (three 
switch  times  and  a(0)),  since  one  shoulder  switch  time  can  be 
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■found  given  the  other  two  shoulder  switch  times  using  the 
integral  (14). 

DISCUSSION  OF  SOLUTIONS 

■  All  o-f  the  minimum  time  paths  start  with  a  rslativsly  sxtsndsd 
arm  con-figuration  and  the  tip  nation  is  dirnctnd  toward  thn 
shouldnr.  For  L/l  >  2.0,  thn  tip  path  passns  through  thn 
shouldnr.  Initially  thn  torquns  arn  o-f  oppositn  sign,  causing  a 
-flipping  notion  o-f  thn  tip. 

■  Thnsn  obsnrvations  arn  consistnnt  with  thn  fact  that  thn 
maxinun  tip  accnlnration  starting  from  rnst  is  obtainnd  with  thn 
nxtnndnd  arn  configuration  and  it  is  dirnctnd  approx inatnly 
toward  thn  shouldnr  (discussnd  in  morn  dntail  in  Rnf.  1). 

■  For  thn  longnr  paths,  thn  arn  tnnds  to  fold  quitn  rapidly. 

This  is  consistnnt  with  thn  fact  that  thn  monnnt  of  innrtia 

of  thn  arn  about  thn  shouldnr  is  minimiznd  whan  thn  arn  is  foldad, 
i.n.  whan  thn  nlbow  angla  a  ■  w. 

SUGGESTIONS  FOR  FURTHER  RESEARCH 

■  Thnsn  solutions  yinld  oonn-1 ooo  tor qua  hintorins  for  particular 
mass  char actor i sties  of  thn  arn  and  tip  mass.  Wn  would  likn  to 
havn  feodback  logic  and  a  capability  for  handling  diffnrnnt  tip 
massas.  This  may  bn  possible  using  a  form  of  “neighboring 
optimum*  feedback  based  on  snail  changes  in  thn  switch  times 
proportional  to  snail  changes  in  final  location  dnsirad  and  snail 
changes  in  tip  mass  (cf.  Rnf.  6). 

■  It  seams  likely  that  for  practical  pick-and-placn  robot  arms, 
soon  form  of  closed-loop  proportional  (as  opposed  to  bang-bang) 
terminal  control  will  ba  required  for  precision  work. 

■  It  seems  possibla  that  a  gradient  algorithm  based  on  switch 
times  (rather  than  nntira  control  histories),  would  find  the 
optimal  paths  much  faster  than  tha  ACW  gradient  algorithm.  A 
problem  here  is  to  determine  the  number  of  switches  in  each 
control . 

■  The  affects  of  flexibility  (vibrations)  must  be  taken  into 
account  for  the  faster,  lighter  links  envisioned  for  future 
robots. 

■  Minimum— time  torque  histories  for  robot  arms  to  follow  a 
desired  path  are  of  interest  (note  the  path  was  open  here,  only 
the  distance  between  the  end-points  was  specified). 

■  Minimum-time  paths  for  robot  arms  with  morn  than  two  links  are 
of  i n tarast . 

■  Minimum-time  paths  to  more  than  one  point  are  of  interest. 
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